-- Logs begin at Sun 2022-10-30 00:05:02 UTC, end at Sun 2022-10-30 01:19:11 UTC. -- Oct 30 00:39:24.568246 dv-cinder-861491-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 30 00:39:24.577633 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 30 00:39:24.579608 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 30 00:39:24 2022] *** Oct 30 00:39:24.579608 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 30 00:39:24.579608 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 30 00:39:24.579608 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: nodename: dv-cinder-861491-6-iscsi Oct 30 00:39:24.579608 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: machine: x86_64 Oct 30 00:39:24.579608 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: clock source: unix Oct 30 00:39:24.579608 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: pcre jit disabled Oct 30 00:39:24.579608 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: detected number of CPU cores: 4 Oct 30 00:39:24.579608 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: current working directory: / Oct 30 00:39:24.579608 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: detected binary path: /usr/bin/uwsgi-core Oct 30 00:39:24.580319 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: your processes number limit is 47680 Oct 30 00:39:24.580319 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: your memory page size is 4096 bytes Oct 30 00:39:24.580319 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: detected max file descriptor number: 2048 Oct 30 00:39:24.580319 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: lock engine: pthread robust mutexes Oct 30 00:39:24.580319 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: thunder lock: enabled Oct 30 00:39:24.580319 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 30 00:39:24.580319 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 30 00:39:24.619854 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: Python main interpreter initialized at 0x56425b41a9c0 Oct 30 00:39:24.619854 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: python threads support enabled Oct 30 00:39:24.619854 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: your server socket listen backlog is limited to 100 connections Oct 30 00:39:24.619854 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: your mercy for graceful operations on workers is 90 seconds Oct 30 00:39:24.620516 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: mapped 403077 bytes (393 KB) for 2 cores Oct 30 00:39:24.620516 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: *** Operational MODE: preforking *** Oct 30 00:39:24.620709 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: *** uWSGI is running in multiple interpreter mode *** Oct 30 00:39:24.620709 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: spawned uWSGI master process (pid: 110516) Oct 30 00:39:24.620741 dv-cinder-861491-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 30 00:39:24.621278 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: spawned uWSGI worker 1 (pid: 110517, cores: 1) Oct 30 00:39:24.622916 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: spawned uWSGI worker 2 (pid: 110518, cores: 1) Oct 30 00:39:24.622916 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 30 00:39:25.292241 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 30 00:39:25.296654 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 30 00:39:26.378758 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 00:39:26.378758 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: from cryptography.utils import int_from_bytes Oct 30 00:39:26.379446 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 00:39:26.379446 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: from cryptography.utils import int_from_bytes Oct 30 00:39:26.379788 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 00:39:26.379788 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: from cryptography.utils import int_from_bytes Oct 30 00:39:26.380230 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 00:39:26.380230 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: from cryptography.utils import int_from_bytes Oct 30 00:39:28.954122 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 30 00:39:28.954681 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 30 00:39:28.954901 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 30 00:39:28.955199 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 30 00:39:28.955577 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 30 00:39:28.955672 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 30 00:39:28.955760 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 30 00:39:28.955884 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.955979 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 30 00:39:28.956232 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.956369 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 30 00:39:28.956555 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.956662 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 30 00:39:28.956875 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.957005 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.957204 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.957333 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.957516 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.957660 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.957839 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.957983 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.958157 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.958319 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.958483 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.958635 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.958729 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.958960 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.959050 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.959282 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.959379 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861491-6-iscsi {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.959613 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.959750 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.959879 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.960007 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.960210 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.960343 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.960539 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861491-6-iscsi {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.960672 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.960864 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.961002 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.961174 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.961314 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.961478 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.961615 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.961802 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.961979 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.962128 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.963679 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.963899 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.963899 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.964292 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.964452 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.964629 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.964629 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.964995 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.965171 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.965386 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.965576 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.965773 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.965968 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.966151 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.966339 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.966530 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.966683 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.966860 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.967068 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.967251 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.967448 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.967640 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861491-6-iscsi {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.967832 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.968019 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.968220 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.968398 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.968556 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861491-6-iscsi {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.968713 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.968844 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.969002 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.969145 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.969309 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.969452 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.969586 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.969717 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.969844 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.969996 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.970126 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.970259 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.970386 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.970522 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.970648 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.970774 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.970901 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.971030 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.971152 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.971272 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.971426 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.971556 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.971693 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.971821 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.971951 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.972072 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.972219 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.972341 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.972472 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.972608 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.972728 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.972847 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.972972 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.973098 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.973227 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.973356 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.973476 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.973602 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.973729 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.973858 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.974012 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.974166 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.974295 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.974425 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.974552 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.974552 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.974876 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.975004 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.975124 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.975124 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.975364 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.975486 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.975617 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.975744 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.975870 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.975999 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.976153 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.976277 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.976398 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.976524 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.976650 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.976790 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.976918 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.977038 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.977163 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.977284 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.977402 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.977540 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.977661 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.977787 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.977914 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.978034 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.978158 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.978286 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.979044 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.979232 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.979460 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.979671 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.979807 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.979943 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.980065 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.980223 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.980346 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.980472 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.980603 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.980731 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.980853 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.980978 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.981098 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.981225 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.981354 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.981476 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.981609 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.981739 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.981860 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.981981 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.982109 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.982230 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.982349 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.982474 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.982602 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.982786 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.982921 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.983096 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.983226 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.983353 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.983478 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.983633 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.983772 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.983938 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.984068 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.984285 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.984411 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.984593 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.984720 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.984899 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.985026 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.985203 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.985332 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.985504 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.985630 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.985813 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.985942 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.986116 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.986247 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.986419 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.986552 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.986723 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.986891 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.987013 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.987139 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.987317 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.987443 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.987620 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.987744 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.987926 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.988058 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.988268 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.988391 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.988543 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.988667 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.988854 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.988992 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.989164 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.989294 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.989467 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.989589 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.989773 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.989906 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.990078 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.990203 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.990382 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.990513 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.990688 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.990820 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.990994 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.991118 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.991297 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.991428 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.991618 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.991749 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.991923 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.992045 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.992253 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.992378 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.992570 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.992704 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.992876 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.993007 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.993182 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.993308 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.993495 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.993632 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.993793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.993924 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.994679 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.994842 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.995051 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.995277 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.995470 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.995598 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.995726 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.995849 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.995979 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.996150 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.996288 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.996418 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.996540 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.996660 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.996844 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.996970 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.997147 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.997271 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.997450 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.997581 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.997750 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.997876 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.998067 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.998198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.998388 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.998515 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.998690 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.998824 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.998995 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.999124 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.999305 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.999437 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.999619 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.999742 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:28.999931 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:29.000056 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.000268 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:29.000402 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.000593 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:39:29.000724 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.000922 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.001052 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.001255 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.001458 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.001585 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.001704 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.001890 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.002013 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.002204 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.002338 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.002518 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.002644 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.002844 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.002970 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.003157 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.003282 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.003470 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.003595 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.003781 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.003905 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.004117 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.004247 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.004438 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.004561 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.004754 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.004887 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.005071 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.005202 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.005389 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.005512 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.005706 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.005831 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.006017 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.006144 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.006333 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.006458 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.006653 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.006775 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.006969 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.007102 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.007277 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.007400 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.007607 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.007735 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.007932 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.008058 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.008270 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.008403 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.008595 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.008729 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.008913 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.009045 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.009231 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.009356 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.009540 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.009673 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.009900 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.010095 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.010294 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.010496 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.010654 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.010787 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.010916 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.011099 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.011226 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.011442 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.011567 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.011762 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.011893 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.012072 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.012307 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.012430 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.012560 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.012706 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.012840 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.013019 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.013146 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.013329 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.013464 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.013643 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.013767 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.013960 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.014091 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.014276 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.014413 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.014590 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.014715 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.014932 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.015068 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.015253 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.015387 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.015568 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.015692 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.015882 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.016007 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.016219 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.016359 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.016528 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.016659 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.016836 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.016970 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.017143 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.017269 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.017455 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.017578 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.017757 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.017886 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.018064 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.018189 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.018373 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.018504 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.018685 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.018818 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.018991 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.019115 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.019314 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.019440 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.019624 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.019754 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.019936 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.020062 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.020270 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.020396 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.020576 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.020717 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.020888 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.021015 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.021201 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.021325 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.021505 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.021640 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.021813 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.021937 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.022129 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.022258 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.022434 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.022569 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.022740 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.022872 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.023051 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.023346 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.023470 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.023659 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.023790 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.023969 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.024120 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.024303 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.024506 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.024633 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.024760 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.024913 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.025047 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.025233 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.025367 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.025574 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.025763 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.025966 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.026181 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.026328 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.026464 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.026588 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.026710 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.026842 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.027020 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.027156 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.027339 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.027465 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.027655 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.027782 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.027993 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.028165 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.028336 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.028468 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.028641 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.028766 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.028950 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.029091 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.029253 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.029386 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.029564 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.029689 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.029880 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.030012 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.030197 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.030322 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.030505 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.030628 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.030814 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.030952 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.031118 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.031255 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.031429 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.031553 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.031736 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.031862 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.032038 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.032186 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.032367 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.032492 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.032673 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.032798 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.032985 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.033111 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.033307 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.033431 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.033619 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.033743 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.033926 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.034051 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.034233 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.034358 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.034543 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.034668 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.034877 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.035001 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.035186 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.035318 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.035496 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.035620 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.035808 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.035932 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.036146 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.036288 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.036460 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.036585 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.036780 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.036905 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.037094 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.037229 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.037412 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.037537 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.037723 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.037854 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.038037 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.038170 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.038347 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.038474 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.038667 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.038792 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.038977 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.039103 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.039294 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.039420 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.039608 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.039738 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.039939 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.040071 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.040280 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.040406 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.040604 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.040737 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.041423 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.041567 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.041758 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.041970 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.042178 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.042342 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.042478 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.042601 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.042728 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.042850 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.043035 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.043162 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.043352 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.043487 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.043671 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.043802 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.043987 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.044194 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.044321 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.044442 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.044629 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.044754 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.044941 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.045072 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.045256 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.045380 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.045569 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.045692 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.045889 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.046028 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.046450 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.046579 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.046781 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.046906 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.047094 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.047228 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.047417 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.047549 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.047726 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.047851 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.048034 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.048182 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.048372 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.048497 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.048683 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.048809 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.048990 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.049117 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.049301 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.049433 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.049612 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.049737 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.049925 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.050049 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.050233 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.050363 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.050545 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.050670 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.050848 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.050981 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.051155 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.051279 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.051458 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.051593 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.051762 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.051888 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.052064 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.052207 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.052398 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.052535 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.052708 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.052831 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.053016 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.053147 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.053324 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.053463 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.053631 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.053756 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.053936 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.054061 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.054242 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.054446 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.054570 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.054689 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.054861 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.054991 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.055163 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.055297 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.055465 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.055590 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.055769 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.055893 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.056121 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.056248 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.056427 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.056604 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.056848 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.057057 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.057287 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.057462 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.057589 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.057710 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.057831 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.057952 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.058130 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.058259 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.058445 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.058571 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.058757 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.058888 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.059079 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.059212 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.059398 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.059532 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.059708 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.059844 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.060019 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.060165 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.060357 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.060482 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.060671 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.060810 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.061023 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.061147 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.061343 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.061462 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.061659 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.061794 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.061975 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.062103 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.062287 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.062414 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.062593 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.062732 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.062904 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.063031 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.063226 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.063352 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.063537 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.063795 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.063928 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.064152 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.064282 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.064471 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.064611 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.064783 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.064906 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.065107 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.065232 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.065436 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.065667 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.065825 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.065999 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.066125 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.066320 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.066452 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.066644 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.066775 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.066966 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.067090 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.067273 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.067409 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.067581 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.067718 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.067894 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.068033 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.068224 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.068350 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.068530 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.068656 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.068835 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.068963 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.069155 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.069287 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.069459 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.069584 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.069761 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.069882 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.070065 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.070190 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.070368 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.070502 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.070676 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.070806 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.070978 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.071115 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.071288 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.071420 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.071592 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.071722 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.071904 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.072026 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.072756 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.072970 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.073178 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.073372 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.073502 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.073625 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.073746 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.073878 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.074006 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.074129 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.074277 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.074404 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.074615 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.074743 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.074946 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.075070 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.075258 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.075385 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.075570 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.075697 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.075875 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.076000 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.076229 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.076357 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.076552 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.076680 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.076894 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.077018 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.077214 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.077348 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.077529 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.077659 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.077838 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.077962 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.078142 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.078275 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.078455 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.078580 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.078762 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.078885 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.079071 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.079278 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.079410 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.079537 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.079679 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.079805 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.079986 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.080146 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.080322 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.080448 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.080634 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.080763 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.080940 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.081063 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.081244 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.081370 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.081547 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.081672 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.081859 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.081984 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.082167 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.082291 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.082470 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.082595 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.082783 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.082914 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.083086 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.083209 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.083389 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.083514 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.083694 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.083825 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.083999 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.084172 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.084326 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.084466 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.084636 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.084768 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.084941 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.085065 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.085244 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.085381 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.085552 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.085688 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.085860 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.085997 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.086161 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.086294 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.086466 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.086592 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.086777 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.086936 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.087080 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.087213 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.087388 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.087514 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.087698 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.087862 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.088582 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.088782 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.088999 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.089186 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.089314 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.089436 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.089570 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.089695 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.089817 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.089945 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.090073 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.090206 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.090395 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.090530 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.090716 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.090844 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.091026 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.091151 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.091331 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.091457 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.091636 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.091764 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.091942 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.092076 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.092273 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.092399 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.092586 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.092709 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.092894 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.093032 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.093196 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.093320 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.093500 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.093623 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.093803 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.093937 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.094110 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.094233 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.094435 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.094560 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.094749 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.094884 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.095055 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.095182 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.095363 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.095488 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.095672 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.095804 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.095988 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.096134 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.096327 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.096452 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.096646 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.096779 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.096955 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.097082 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.097275 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.097400 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.097588 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.097714 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.097902 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.098025 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.098205 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.098335 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.098510 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.098636 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.098818 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.098941 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.099132 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.099262 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.099445 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.099569 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.099762 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.099887 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.100071 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.100231 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.100414 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.100539 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.100716 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.100840 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.101028 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.101156 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.101340 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.101473 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.101648 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.101771 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.101958 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.102092 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.102269 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.102401 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.102580 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.102705 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.102892 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.103023 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.103200 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.103325 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.103538 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.103721 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.103941 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.104197 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.104197 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.104438 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.104559 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.104693 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.104830 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.104953 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.105074 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.105195 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.105384 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.105521 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.105699 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.105826 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.106008 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.106141 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.106325 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.106452 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.106639 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.106772 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.106947 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.107073 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.107251 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.107384 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.107575 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.107700 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.107883 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.108010 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.108220 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.108423 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.108549 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.108670 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.108834 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.108960 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.109143 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.109276 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.109500 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.109635 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.109814 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.109946 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.110118 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.110252 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.110472 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.110601 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.110787 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.110919 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.111102 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.111229 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.111422 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.111554 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.111723 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.111848 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.112026 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.112205 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.112361 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.112497 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.112685 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.112812 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.112989 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.113117 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.113293 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.113419 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.113598 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.113732 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.113920 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.114047 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.114223 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.114349 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.114541 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.114675 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.114865 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.114988 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.115175 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.115301 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.115483 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.115616 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.115809 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.115935 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.116136 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.116265 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.116463 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.116601 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.116885 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.117012 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.117201 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.117327 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.117510 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.117660 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.117796 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.117927 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.118113 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.118239 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.118423 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.118549 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.118745 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.118948 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.119250 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.119455 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.119670 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.119854 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.119991 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.120152 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.120278 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.120402 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.120532 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.120655 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.120789 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.120919 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.121042 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.121164 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.121351 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.121477 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.121671 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.121796 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.121982 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.122108 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.122313 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.122446 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.122641 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.122774 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.123005 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.123139 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.123263 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.123393 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.123569 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.123710 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.123880 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.124007 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.124209 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.124516 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.124642 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.124838 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.124971 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.125145 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.125271 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.125456 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.125589 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.125765 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.125899 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.126074 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.126199 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.126379 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.126506 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.126681 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.126807 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.127002 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.127137 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.127304 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.127430 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.127617 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.127741 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.127928 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.128060 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.128267 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.128391 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.128578 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.128705 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.128881 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.129014 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.129206 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.129330 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.129513 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.129639 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.129817 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.129959 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.130119 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.130245 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.130423 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.130555 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.130765 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.130898 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.131070 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.131194 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.131393 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.131518 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.131706 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.131831 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.132017 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.132159 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.132357 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.132483 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.132668 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.132795 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.133001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.133132 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.133307 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.133431 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.133615 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.133741 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.133931 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.134057 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.134254 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.134439 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.134566 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.135206 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.135375 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.135574 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.135781 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.135984 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.136163 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.136290 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.136412 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.136533 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.136654 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.136789 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.136914 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.137036 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.137157 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.137344 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.137470 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.137655 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.137788 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.137969 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.138096 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.138276 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.138410 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.138585 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.138711 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.138894 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.139020 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.139209 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.139344 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.139509 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.139633 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.139815 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.139945 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.140159 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.140301 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.140467 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.140598 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.140774 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.140905 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.141089 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.141222 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.141403 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.141526 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.141713 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.141839 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.142022 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.142149 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.142329 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.142461 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.142640 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.142768 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.142954 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.143081 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.143268 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.143393 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.143580 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.143712 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.143889 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.144016 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.144225 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.144353 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.144542 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.144670 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.144859 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.144984 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.145181 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.145375 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.145508 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.145703 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.145830 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.146017 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.146144 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.146332 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.146464 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.146646 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.146773 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.146959 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.147085 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.147272 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.147399 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.147585 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.147836 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.147963 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.148193 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.148321 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.148516 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.148718 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.148852 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.148966 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.149141 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.149266 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.149460 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.149587 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.149778 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.149904 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.150095 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.150230 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.150971 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.151169 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.151353 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.151564 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.151759 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.151886 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.152010 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.152183 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.152315 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.152471 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.152599 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.152810 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.152937 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.153150 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.153274 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.153465 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.153590 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.153776 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.153903 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.154087 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.154213 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.154398 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.154533 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.154709 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.154835 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.155021 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.155146 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.155330 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.155468 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.155640 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.155774 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.155952 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.156098 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.156298 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.156424 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.156617 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.156743 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.156932 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.157065 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.157245 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.157370 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.157558 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.157685 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.157872 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.157995 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.158186 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.158387 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.158525 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.158702 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.158827 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.159033 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.159160 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.159358 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.159483 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.159687 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.159812 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.160001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.160172 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.160341 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.160467 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.160667 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.160794 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.160972 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.161195 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.161319 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.161514 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.161640 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.161850 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.161983 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.162158 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.162362 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.162487 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.162598 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.162794 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.162922 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.163099 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.163231 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.163416 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.163542 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.163725 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.163852 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.164066 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.164280 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.164406 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.164625 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.164764 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.164943 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.165068 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.165266 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.165398 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.165588 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.165716 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.165918 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.166047 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.166225 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.166438 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.166659 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.166812 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.166935 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.167140 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.167267 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.167455 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.167591 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.167764 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.167890 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.168066 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.168228 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.168391 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.168527 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.168702 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.168828 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.169012 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.169138 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.169316 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.169454 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.169630 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.169763 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.169933 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.170059 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.170256 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.170384 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.170560 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.170686 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.170863 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.170988 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.171166 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.171554 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.171737 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.171861 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.172037 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.172193 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.172364 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.172493 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.172667 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.172792 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.172970 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.173095 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.173279 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.173406 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.173581 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.173707 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.173889 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.174024 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.174195 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.174318 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.174502 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.174626 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.174805 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.174938 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.175115 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.175240 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.175423 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.175549 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.175729 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.175863 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.176032 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.176194 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.176360 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.176486 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.176672 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.176805 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.176980 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.177105 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.177297 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.177422 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.177608 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.177741 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.177919 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.178046 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.178250 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.178374 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.178575 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.178705 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.178872 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.179081 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.179207 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.179416 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.179552 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.179743 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.179870 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.180075 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.180227 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.180424 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.180558 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.180729 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.180859 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.181035 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.181168 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.181339 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.181466 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.181748 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.182023 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.182241 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.182410 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.182546 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.182678 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.182812 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.183013 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.183139 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.183353 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.183487 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.183669 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.183796 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.183984 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.184134 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.184327 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.184454 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.184643 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.184768 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.184953 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.185081 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.185262 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.185389 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.185573 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.185699 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.185884 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.186007 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.186193 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.186317 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.186506 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.186642 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.186822 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.186985 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.187122 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.187245 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.187438 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.187570 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.187748 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.187884 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.188059 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.188242 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.188390 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.188513 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.188699 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.188836 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.189007 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.189133 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.189315 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.189440 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.189635 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.189770 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.189961 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.190099 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.190275 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.190401 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.190578 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.190714 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.190899 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.191212 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.191335 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.191525 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.191660 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.191838 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.191963 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.192179 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.192305 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.192494 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.192636 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.192818 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.192956 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.193134 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.193270 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.193441 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.193569 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.193761 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.194072 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.194204 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.194400 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.194540 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.194725 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.194849 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.195052 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.195184 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.195368 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.195501 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.195672 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.195803 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.195975 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.196137 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.196301 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.196428 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.196612 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.196738 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.196929 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.197055 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.197859 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.198054 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.198260 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.198464 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.198464 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.198706 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.198838 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.198961 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.199083 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.199204 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.199325 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.199454 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.199611 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.199737 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.199915 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.200039 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.200251 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.200391 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.200554 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.200683 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.200858 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.200983 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.201161 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.201293 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.201463 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.201587 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.201767 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.201899 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.202074 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.202208 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.202382 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.202500 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.202696 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.202821 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.203009 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.203136 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.203312 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.203435 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.203616 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.203740 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.203917 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.204044 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.204247 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.204372 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.204555 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.204680 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.204864 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.204992 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.205177 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.205302 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.205483 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.205607 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.205790 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.205922 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.206098 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.206222 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.206404 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.206538 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.206708 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.206839 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.207022 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.207160 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.207331 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.207470 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.207662 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.207794 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.207974 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.208130 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.208310 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.208516 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.208638 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.208759 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.208921 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.209048 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.209232 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.209367 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.209541 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.209667 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.209854 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.209977 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.210166 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.210294 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.210478 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.210608 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.210802 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.210927 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.211114 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.211238 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.211430 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.211555 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.211744 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.211870 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.212053 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.212231 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.212388 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.212512 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.212704 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.212889 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.213618 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.213818 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.214028 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.214211 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.214338 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.214472 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.214595 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.214725 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.214848 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.215027 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.215153 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.215341 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.215469 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.215655 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.215781 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.215973 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.216131 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.216319 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.216457 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.216648 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.216774 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.216975 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.217114 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.217317 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.217441 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.217638 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.217763 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.217955 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.218090 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.218272 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.218398 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.218592 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.218718 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.218913 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.219040 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.219244 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.219375 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.219574 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.219700 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.219891 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.220017 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.220220 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.220344 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.220466 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110517) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 30 00:39:29.220588 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.220900 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.221216 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.221562 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.221895 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.222214 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.222537 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.222848 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:39:29.223095 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110518) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 30 00:39:29.375772 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO dbcounter [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] Registered counter for database nova_api Oct 30 00:39:29.377664 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO dbcounter [None req-46a1cdf0-7aaa-4fa8-82f4-1e082b9e7416 None None] Registered counter for database nova_api Oct 30 00:39:29.397353 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_db.sqlalchemy.engines [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 00:39:29.399073 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG oslo_db.sqlalchemy.engines [None req-46a1cdf0-7aaa-4fa8-82f4-1e082b9e7416 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 00:39:29.405008 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG dbcounter [-] [110517] Writer thread running {{(pid=110517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 00:39:29.406169 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG dbcounter [-] [110518] Writer thread running {{(pid=110518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 00:39:29.461376 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.context [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ea66ce74-ff55-4058-9ca3-10a503c16d39(cell1) {{(pid=110517) load_cells /opt/stack/nova/nova/context.py:464}} Oct 30 00:39:29.463534 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.context [None req-46a1cdf0-7aaa-4fa8-82f4-1e082b9e7416 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ea66ce74-ff55-4058-9ca3-10a503c16d39(cell1) {{(pid=110518) load_cells /opt/stack/nova/nova/context.py:464}} Oct 30 00:39:29.465760 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:39:29.466234 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:39:29.467391 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG oslo_concurrency.lockutils [None req-46a1cdf0-7aaa-4fa8-82f4-1e082b9e7416 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:39:29.467829 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:39:29.467923 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG oslo_concurrency.lockutils [None req-46a1cdf0-7aaa-4fa8-82f4-1e082b9e7416 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:39:29.468573 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:39:29.469010 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:39:29.469470 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG oslo_concurrency.lockutils [None req-46a1cdf0-7aaa-4fa8-82f4-1e082b9e7416 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:39:29.470190 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG oslo_concurrency.lockutils [None req-46a1cdf0-7aaa-4fa8-82f4-1e082b9e7416 None None] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:39:29.470633 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG oslo_concurrency.lockutils [None req-46a1cdf0-7aaa-4fa8-82f4-1e082b9e7416 None None] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:39:29.470998 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:39:29.472653 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG oslo_concurrency.lockutils [None req-46a1cdf0-7aaa-4fa8-82f4-1e082b9e7416 None None] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110518) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:39:29.473004 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO dbcounter [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] Registered counter for database nova_cell0 Oct 30 00:39:29.474638 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO dbcounter [None req-46a1cdf0-7aaa-4fa8-82f4-1e082b9e7416 None None] Registered counter for database nova_cell0 Oct 30 00:39:29.477091 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO dbcounter [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] Registered counter for database nova_cell1 Oct 30 00:39:29.479405 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO dbcounter [None req-46a1cdf0-7aaa-4fa8-82f4-1e082b9e7416 None None] Registered counter for database nova_cell1 Oct 30 00:39:29.485511 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_db.sqlalchemy.engines [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 00:39:29.486833 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_db.sqlalchemy.engines [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 00:39:29.490099 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG oslo_db.sqlalchemy.engines [None req-46a1cdf0-7aaa-4fa8-82f4-1e082b9e7416 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 00:39:29.492244 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG oslo_db.sqlalchemy.engines [None req-46a1cdf0-7aaa-4fa8-82f4-1e082b9e7416 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 00:39:29.492700 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG dbcounter [-] [110517] Writer thread running {{(pid=110517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 00:39:29.495830 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG dbcounter [-] [110518] Writer thread running {{(pid=110518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 00:39:29.631994 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG dbcounter [-] [110517] Writer thread running {{(pid=110517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 00:39:29.637659 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG dbcounter [-] [110518] Writer thread running {{(pid=110518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 00:39:29.642510 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO dbcounter [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] Registered counter for database nova_cell0 Oct 30 00:39:29.646920 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO dbcounter [None req-46a1cdf0-7aaa-4fa8-82f4-1e082b9e7416 None None] Registered counter for database nova_cell0 Oct 30 00:39:29.649560 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_db.sqlalchemy.engines [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110517) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 00:39:29.654537 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG dbcounter [-] [110517] Writer thread running {{(pid=110517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 00:39:29.655911 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG oslo_db.sqlalchemy.engines [None req-46a1cdf0-7aaa-4fa8-82f4-1e082b9e7416 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110518) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 00:39:29.660573 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG dbcounter [-] [110518] Writer thread running {{(pid=110518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 00:39:29.993407 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: WARNING keystonemiddleware.auth_token [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 00:39:30.000379 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: WARNING keystonemiddleware.auth_token [None req-46a1cdf0-7aaa-4fa8-82f4-1e082b9e7416 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 00:39:30.001270 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: WARNING keystonemiddleware.auth_token [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 00:39:30.007591 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: WARNING keystonemiddleware.auth_token [None req-46a1cdf0-7aaa-4fa8-82f4-1e082b9e7416 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 00:39:30.344764 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: WARNING keystonemiddleware.auth_token [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 00:39:30.350692 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: WARNING keystonemiddleware.auth_token [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 00:39:30.352614 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: WARNING keystonemiddleware.auth_token [None req-46a1cdf0-7aaa-4fa8-82f4-1e082b9e7416 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 00:39:30.356767 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56425b41a9c0 pid: 110517 (default app) Oct 30 00:39:30.358852 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:39:30.359121 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: WARNING keystonemiddleware.auth_token [None req-46a1cdf0-7aaa-4fa8-82f4-1e082b9e7416 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 00:39:30.360025 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001723 Oct 30 00:39:30.360460 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Sun Oct 30 00:39:30 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:39:30.364433 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56425b41a9c0 pid: 110518 (default app) Oct 30 00:40:52.537184 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:40:52.538105 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 30 00:40:52.538673 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 2/2] 10.222.0.36 () {54 vars in 931 bytes} [Sun Oct 30 00:40:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:40:52.556468 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG dbcounter [-] [110518] Writing DB stats nova_api:SELECT=3 {{(pid=110518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:52.557396 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG dbcounter [-] [110518] Writing DB stats nova_cell0:SELECT=3 {{(pid=110518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:52.558591 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG dbcounter [-] [110518] Writing DB stats nova_cell1:SELECT=3 {{(pid=110518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:52.559438 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG dbcounter [-] [110518] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:53.419804 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-c298d053-bd94-4dd7-94b0-7e73f9dd04db admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:40:53.453563 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-c298d053-bd94-4dd7-94b0-7e73f9dd04db admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.907468 Oct 30 00:40:53.454755 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1292 bytes} [Sun Oct 30 00:40:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:40:56.133748 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:40:56.134740 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-c3c07721-1600-4f0c-bff3-b7fc906ee3c2 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Oct 30 00:40:56.135141 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 3/4] 10.222.0.36 () {54 vars in 931 bytes} [Sun Oct 30 00:40:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:40:56.578479 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-27c7b653-e84d-45db-a122-8dccfc999b75 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "id": "c1", "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:40:56.626084 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-27c7b653-e84d-45db-a122-8dccfc999b75 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.483983 Oct 30 00:40:56.626824 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 2/5] 10.222.0.36 () {64 vars in 1283 bytes} [Sun Oct 30 00:40:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:40:56.640859 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG dbcounter [-] [110517] Writing DB stats nova_api:SELECT=3 {{(pid=110517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:56.641702 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG dbcounter [-] [110517] Writing DB stats nova_cell1:SELECT=3 {{(pid=110517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:56.643632 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG dbcounter [-] [110517] Writing DB stats nova_cell0:SELECT=3 {{(pid=110517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:56.645473 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG dbcounter [-] [110517] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:40:56.846956 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-4f5569e8-cc20-4faa-95f7-1de81307abb1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:40:56.918295 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-4f5569e8-cc20-4faa-95f7-1de81307abb1 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283215 Oct 30 00:40:56.918886 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 4/6] 10.222.0.36 () {64 vars in 1336 bytes} [Sun Oct 30 00:40:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:40:59.526270 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-27c7b653-e84d-45db-a122-8dccfc999b75 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:40:59.527295 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-27c7b653-e84d-45db-a122-8dccfc999b75 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 30 00:40:59.527910 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 3/7] 10.222.0.36 () {54 vars in 931 bytes} [Sun Oct 30 00:40:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:41:00.210999 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-98d85dd3-1d17-4eea-a26d-b8797a9445e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d1", "swap": 0, "disk": 5}} {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:41:00.253564 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-98d85dd3-1d17-4eea-a26d-b8797a9445e4 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.717854 Oct 30 00:41:00.254299 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 5/8] 10.222.0.36 () {64 vars in 1283 bytes} [Sun Oct 30 00:40:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:41:00.266701 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-7cb5e210-db00-4cce-9a0c-575c234f8d56 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:41:00.307269 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-7cb5e210-db00-4cce-9a0c-575c234f8d56 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044710 Oct 30 00:41:00.307857 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 4/9] 10.222.0.36 () {64 vars in 1336 bytes} [Sun Oct 30 00:41:00 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:41:02.952039 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-98d85dd3-1d17-4eea-a26d-b8797a9445e4 admin admin] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:02.953077 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-98d85dd3-1d17-4eea-a26d-b8797a9445e4 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 30 00:41:02.953479 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 6/10] 10.222.0.36 () {54 vars in 931 bytes} [Sun Oct 30 00:41:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:41:03.384012 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-53dc38c1-184d-457d-99c2-f685fe67cee7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "os-flavor-access:is_public": true, "name": "ds1G", "rxtx_factor": 1.0, "id": "d2"}} {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:41:03.406988 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-53dc38c1-184d-457d-99c2-f685fe67cee7 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446663 Oct 30 00:41:03.407755 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 5/11] 10.222.0.36 () {64 vars in 1283 bytes} [Sun Oct 30 00:41:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 00:41:03.420500 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-14672be9-9e93-497c-a612-ca025a3d11d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:41:03.449550 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-14672be9-9e93-497c-a612-ca025a3d11d0 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033297 Oct 30 00:41:03.450119 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 7/12] 10.222.0.36 () {64 vars in 1336 bytes} [Sun Oct 30 00:41:03 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:41:06.112427 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-53dc38c1-184d-457d-99c2-f685fe67cee7 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:06.113447 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-53dc38c1-184d-457d-99c2-f685fe67cee7 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Oct 30 00:41:06.113846 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 6/13] 10.222.0.36 () {54 vars in 931 bytes} [Sun Oct 30 00:41:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:41:06.572602 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-f9b11b0b-c742-4934-a95f-e56ad291fbe4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 10, "rxtx_factor": 1.0, "id": "d3", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G"}} {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:41:06.592433 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-f9b11b0b-c742-4934-a95f-e56ad291fbe4 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.472477 Oct 30 00:41:06.592986 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 8/14] 10.222.0.36 () {64 vars in 1283 bytes} [Sun Oct 30 00:41:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 30 00:41:06.605350 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-83071325-9492-4f83-819a-4b522e7031a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:41:06.632161 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-83071325-9492-4f83-819a-4b522e7031a9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030627 Oct 30 00:41:06.632813 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 7/15] 10.222.0.36 () {64 vars in 1336 bytes} [Sun Oct 30 00:41:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:41:09.316435 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-f9b11b0b-c742-4934-a95f-e56ad291fbe4 admin admin] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:09.317830 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-f9b11b0b-c742-4934-a95f-e56ad291fbe4 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001996 Oct 30 00:41:09.318370 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 9/16] 10.222.0.36 () {54 vars in 931 bytes} [Sun Oct 30 00:41:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:41:09.813335 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-97956a8b-a925-4454-958c-7f90dba413c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "id": "d4", "disk": 20, "name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:41:09.839680 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-97956a8b-a925-4454-958c-7f90dba413c1 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.513556 Oct 30 00:41:09.840542 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 8/17] 10.222.0.36 () {64 vars in 1283 bytes} [Sun Oct 30 00:41:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:41:09.856468 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-9d1e6d2c-1154-4efa-a1f0-7b7f1d89b019 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:41:09.885271 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-9d1e6d2c-1154-4efa-a1f0-7b7f1d89b019 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032779 Oct 30 00:41:09.885869 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 10/18] 10.222.0.36 () {64 vars in 1336 bytes} [Sun Oct 30 00:41:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:41:12.606960 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-97956a8b-a925-4454-958c-7f90dba413c1 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:12.608992 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-97956a8b-a925-4454-958c-7f90dba413c1 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002525 Oct 30 00:41:12.609397 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 9/19] 10.222.0.36 () {54 vars in 931 bytes} [Sun Oct 30 00:41:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:41:13.032406 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-ebadd1ec-4bd4-4f9d-934c-eca9690eb92c admin admin] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:13.063213 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-ebadd1ec-4bd4-4f9d-934c-eca9690eb92c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.447270 Oct 30 00:41:13.063788 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 11/20] 10.222.0.36 () {60 vars in 1292 bytes} [Sun Oct 30 00:41:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:41:15.739691 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-97956a8b-a925-4454-958c-7f90dba413c1 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:15.740755 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-97956a8b-a925-4454-958c-7f90dba413c1 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 30 00:41:15.741152 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 10/21] 10.222.0.36 () {54 vars in 931 bytes} [Sun Oct 30 00:41:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:41:16.175228 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-6cb01b61-c538-4d5b-8ced-fb31c4d8e873 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.tiny", "id": "1", "vcpus": 1, "rxtx_factor": 1.0, "disk": 1}} {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:41:16.195031 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-6cb01b61-c538-4d5b-8ced-fb31c4d8e873 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.447506 Oct 30 00:41:16.195583 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 12/22] 10.222.0.36 () {64 vars in 1283 bytes} [Sun Oct 30 00:41:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:41:16.209675 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-793f24f7-c452-4b6c-9b84-d6e31ebd19a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:41:16.239726 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-793f24f7-c452-4b6c-9b84-d6e31ebd19a1 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034586 Oct 30 00:41:16.240357 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 11/23] 10.222.0.36 () {64 vars in 1333 bytes} [Sun Oct 30 00:41:16 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:41:18.832309 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-6cb01b61-c538-4d5b-8ced-fb31c4d8e873 admin admin] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:18.833327 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-6cb01b61-c538-4d5b-8ced-fb31c4d8e873 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Oct 30 00:41:18.833744 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 931 bytes} [Sun Oct 30 00:41:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:41:19.241277 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-f51d7be4-2bb0-45f6-ad17-6d3a9aa62455 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:41:19.259806 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-f51d7be4-2bb0-45f6-ad17-6d3a9aa62455 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.419894 Oct 30 00:41:19.260396 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 12/25] 10.222.0.36 () {64 vars in 1283 bytes} [Sun Oct 30 00:41:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:41:19.273202 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-0bd10de2-1759-4d72-a062-0c4f8bd4346a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:41:19.298414 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-0bd10de2-1759-4d72-a062-0c4f8bd4346a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028847 Oct 30 00:41:19.299190 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 14/26] 10.222.0.36 () {64 vars in 1333 bytes} [Sun Oct 30 00:41:19 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:41:21.952446 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-f51d7be4-2bb0-45f6-ad17-6d3a9aa62455 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:21.954626 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-f51d7be4-2bb0-45f6-ad17-6d3a9aa62455 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002957 Oct 30 00:41:21.955144 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 13/27] 10.222.0.36 () {54 vars in 931 bytes} [Sun Oct 30 00:41:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:41:22.374643 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-01f80311-9c69-4167-933d-4498336e83fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "id": "3"}} {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:41:22.398743 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-01f80311-9c69-4167-933d-4498336e83fd admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.437315 Oct 30 00:41:22.407830 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 15/28] 10.222.0.36 () {64 vars in 1283 bytes} [Sun Oct 30 00:41:21 2022] POST /compute/v2.1/flavors => generated 406 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:41:22.414352 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-8c450ae1-8162-4e67-abff-8d663fb19c29 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:41:22.445119 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-8c450ae1-8162-4e67-abff-8d663fb19c29 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035447 Oct 30 00:41:22.446098 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 14/29] 10.222.0.36 () {64 vars in 1333 bytes} [Sun Oct 30 00:41:22 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:41:25.099459 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-01f80311-9c69-4167-933d-4498336e83fd admin admin] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:25.100407 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-01f80311-9c69-4167-933d-4498336e83fd admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 30 00:41:25.101001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 16/30] 10.222.0.36 () {54 vars in 931 bytes} [Sun Oct 30 00:41:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:41:25.594781 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-c0ae97bb-9f79-4e9d-9ed1-5facdc1e3e59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "vcpus": 4, "disk": 80, "ram": 8192, "rxtx_factor": 1.0, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:41:25.600984 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG dbcounter [-] [110518] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:25.616611 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-c0ae97bb-9f79-4e9d-9ed1-5facdc1e3e59 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.509589 Oct 30 00:41:25.620538 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 15/31] 10.222.0.36 () {64 vars in 1283 bytes} [Sun Oct 30 00:41:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:41:25.629984 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-104db80c-cbc6-40ae-91cd-c70c9fbc8adc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:41:25.656497 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-104db80c-cbc6-40ae-91cd-c70c9fbc8adc admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030529 Oct 30 00:41:25.657380 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 17/32] 10.222.0.36 () {64 vars in 1333 bytes} [Sun Oct 30 00:41:25 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:41:28.303051 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-c0ae97bb-9f79-4e9d-9ed1-5facdc1e3e59 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:28.304066 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-c0ae97bb-9f79-4e9d-9ed1-5facdc1e3e59 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 30 00:41:28.305069 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 16/33] 10.222.0.36 () {54 vars in 931 bytes} [Sun Oct 30 00:41:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:41:28.742100 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-16ad353d-acf1-4cf1-9214-e53af7963608 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:41:28.753876 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG dbcounter [-] [110517] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=110517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:28.766878 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-16ad353d-acf1-4cf1-9214-e53af7963608 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.455721 Oct 30 00:41:28.767637 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 18/34] 10.222.0.36 () {64 vars in 1283 bytes} [Sun Oct 30 00:41:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:41:28.779497 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-6114394c-79bf-4c4b-972f-fa11e32cb208 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:41:28.805731 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-6114394c-79bf-4c4b-972f-fa11e32cb208 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029824 Oct 30 00:41:28.820324 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 17/35] 10.222.0.36 () {64 vars in 1333 bytes} [Sun Oct 30 00:41:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:41:48.514192 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-16ad353d-acf1-4cf1-9214-e53af7963608 admin admin] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:48.515711 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-16ad353d-acf1-4cf1-9214-e53af7963608 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Oct 30 00:41:48.516150 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 19/36] 10.222.0.36 () {54 vars in 931 bytes} [Sun Oct 30 00:41:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:41:48.526948 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG dbcounter [-] [110518] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:41:48.910880 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-3e15ba97-b5e4-4928-8665-9919fa17af27 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:48.929390 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-3e15ba97-b5e4-4928-8665-9919fa17af27 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.406879 Oct 30 00:41:48.929930 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1292 bytes} [Sun Oct 30 00:41:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:41:50.229166 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-16ad353d-acf1-4cf1-9214-e53af7963608 admin admin] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:50.230167 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-16ad353d-acf1-4cf1-9214-e53af7963608 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Oct 30 00:41:50.230564 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 20/38] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Oct 30 00:41:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:41:50.772258 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-bef3cd88-5981-4682-a964-63cb6da00082 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:50.777505 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.wsgi [None req-bef3cd88-5981-4682-a964-63cb6da00082 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 30 00:41:50.780702 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-bef3cd88-5981-4682-a964-63cb6da00082 admin admin] Request method failure captured: Oct 30 00:41:50.780702 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 30 00:41:50.780702 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Accept: application/json Oct 30 00:41:50.780702 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Accept-Encoding: gzip, deflate Oct 30 00:41:50.780702 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Connection: keep-alive Oct 30 00:41:50.780702 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Content-Length: 0 Oct 30 00:41:50.780702 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Host: 10.222.0.36 Oct 30 00:41:50.780702 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Openstack-Api-Version: compute 2.92 Oct 30 00:41:50.780702 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Openstack-System-Scope: None Oct 30 00:41:50.780702 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: User-Agent: python-novaclient Oct 30 00:41:50.780702 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Auth-Token: gAAAAABjXchOtuIApSAFDTteBrQyjLG0474POdSQ-2i7qMzkJBgkYvNb8CfhFoMtee6WUB2z0kLtHKfKSZd5xRPaMXFUY21Hk9dwuprLR3q1Yy6SDJEFhTI448Lou1QRbhjUJmUz55d3l4M_6k-G-SZvjxAw1ykAL__jH6BhSdmf5rof5HEo03E Oct 30 00:41:50.780702 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Domain-Id: None Oct 30 00:41:50.780702 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Domain-Name: None Oct 30 00:41:50.780702 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Identity-Status: Confirmed Oct 30 00:41:50.780702 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Is-Admin-Project: True Oct 30 00:41:50.780702 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Openstack-Nova-Api-Version: 2.92 Oct 30 00:41:50.780702 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Project-Domain-Id: default Oct 30 00:41:50.780702 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Project-Domain-Name: Default Oct 30 00:41:50.780702 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Project-Id: 3c2609b991ac4a86bca190e144b13290 Oct 30 00:41:50.780702 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Project-Name: admin Oct 30 00:41:50.780702 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Role: member,reader,admin Oct 30 00:41:50.780702 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Roles: member,reader,admin Oct 30 00:41:50.782763 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3c2609b991ac4a86bca190e144b13290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c2609b991ac4a86bca190e144b13290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3c2609b991ac4a86bca190e144b13290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c2609b991ac4a86bca190e144b13290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:41:50.782763 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Tenant: admin Oct 30 00:41:50.782763 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Tenant-Id: 3c2609b991ac4a86bca190e144b13290 Oct 30 00:41:50.782763 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Tenant-Name: admin Oct 30 00:41:50.782763 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-User: admin Oct 30 00:41:50.782763 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-User-Domain-Id: default Oct 30 00:41:50.782763 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-User-Domain-Name: Default Oct 30 00:41:50.782763 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-User-Id: 245a44aa1d7f43fcad2e727557036aab Oct 30 00:41:50.782763 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-User-Name: admin Oct 30 00:41:50.782763 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: method: > Oct 30 00:41:50.782763 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: exception: Flavor 42 could not be found. Oct 30 00:41:50.782763 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: action_args: {'id': '42'} Oct 30 00:41:50.782763 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:41:50.782763 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:41:50.783720 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 30 00:41:50.783720 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 30 00:41:50.783720 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 30 00:41:50.783720 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 30 00:41:50.783720 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 00:41:50.783720 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 00:41:50.783720 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 30 00:41:50.783720 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 30 00:41:50.783720 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 30 00:41:50.783720 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:41:50.783720 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 30 00:41:50.783720 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 30 00:41:50.783720 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 30 00:41:50.783720 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Oct 30 00:41:50.783720 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:41:50.783720 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Oct 30 00:41:50.783720 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:41:50.783720 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:41:50.783720 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:41:50.786137 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:41:50.786137 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:41:50.786137 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:41:50.786137 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:41:50.786137 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 30 00:41:50.786137 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:41:50.786137 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 30 00:41:50.786137 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Oct 30 00:41:50.786137 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:41:50.786137 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Oct 30 00:41:50.786137 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:41:50.786137 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:41:50.786137 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:41:50.786137 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:41:50.786137 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:41:50.786137 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 30 00:41:50.786137 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Oct 30 00:41:50.786137 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-bef3cd88-5981-4682-a964-63cb6da00082 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:41:50.788244 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-bef3cd88-5981-4682-a964-63cb6da00082 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.405192 Oct 30 00:41:50.788244 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1190 bytes} [Sun Oct 30 00:41:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 30 00:41:50.792547 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-03bb5ae8-7d4b-40b7-be12-0721e56e69ae admin admin] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:50.817336 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-03bb5ae8-7d4b-40b7-be12-0721e56e69ae admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028363 Oct 30 00:41:50.817885 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 21/40] 10.222.0.36 () {60 vars in 1210 bytes} [Sun Oct 30 00:41:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:41:50.828928 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-b993b44b-53dc-43d2-b90a-0e0355e10e82 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:50.850758 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-b993b44b-53dc-43d2-b90a-0e0355e10e82 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026858 Oct 30 00:41:50.851295 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 20/41] 10.222.0.36 () {60 vars in 1210 bytes} [Sun Oct 30 00:41:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:41:50.861181 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-193c7a77-7112-4d1e-a954-48f17d69320f admin admin] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:50.867145 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.wsgi [None req-193c7a77-7112-4d1e-a954-48f17d69320f admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 30 00:41:50.870443 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-193c7a77-7112-4d1e-a954-48f17d69320f admin admin] Request method failure captured: Oct 30 00:41:50.870443 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 30 00:41:50.870443 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Accept: application/json Oct 30 00:41:50.870443 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Accept-Encoding: gzip, deflate Oct 30 00:41:50.870443 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Connection: keep-alive Oct 30 00:41:50.870443 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Content-Length: 0 Oct 30 00:41:50.870443 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Host: 10.222.0.36 Oct 30 00:41:50.870443 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Openstack-Api-Version: compute 2.92 Oct 30 00:41:50.870443 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Openstack-System-Scope: None Oct 30 00:41:50.870443 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: User-Agent: python-novaclient Oct 30 00:41:50.870443 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Auth-Token: gAAAAABjXchOtuIApSAFDTteBrQyjLG0474POdSQ-2i7qMzkJBgkYvNb8CfhFoMtee6WUB2z0kLtHKfKSZd5xRPaMXFUY21Hk9dwuprLR3q1Yy6SDJEFhTI448Lou1QRbhjUJmUz55d3l4M_6k-G-SZvjxAw1ykAL__jH6BhSdmf5rof5HEo03E Oct 30 00:41:50.870443 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Domain-Id: None Oct 30 00:41:50.870443 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Domain-Name: None Oct 30 00:41:50.870443 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Identity-Status: Confirmed Oct 30 00:41:50.870443 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Is-Admin-Project: True Oct 30 00:41:50.870443 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Openstack-Nova-Api-Version: 2.92 Oct 30 00:41:50.870443 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Project-Domain-Id: default Oct 30 00:41:50.870443 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Project-Domain-Name: Default Oct 30 00:41:50.870443 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Project-Id: 3c2609b991ac4a86bca190e144b13290 Oct 30 00:41:50.870443 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Project-Name: admin Oct 30 00:41:50.870443 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Role: member,reader,admin Oct 30 00:41:50.870443 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Roles: member,reader,admin Oct 30 00:41:50.871857 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3c2609b991ac4a86bca190e144b13290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c2609b991ac4a86bca190e144b13290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3c2609b991ac4a86bca190e144b13290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c2609b991ac4a86bca190e144b13290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:41:50.871857 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Tenant: admin Oct 30 00:41:50.871857 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Tenant-Id: 3c2609b991ac4a86bca190e144b13290 Oct 30 00:41:50.871857 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Tenant-Name: admin Oct 30 00:41:50.871857 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-User: admin Oct 30 00:41:50.871857 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-User-Domain-Id: default Oct 30 00:41:50.871857 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-User-Domain-Name: Default Oct 30 00:41:50.871857 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-User-Id: 245a44aa1d7f43fcad2e727557036aab Oct 30 00:41:50.871857 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-User-Name: admin Oct 30 00:41:50.871857 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: method: > Oct 30 00:41:50.871857 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: exception: Flavor 42 could not be found. Oct 30 00:41:50.871857 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: action_args: {'id': '42'} Oct 30 00:41:50.871857 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:41:50.871857 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:41:50.872895 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 30 00:41:50.872895 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 30 00:41:50.872895 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 30 00:41:50.872895 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 30 00:41:50.872895 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 00:41:50.872895 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 00:41:50.872895 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 30 00:41:50.872895 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 30 00:41:50.872895 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 30 00:41:50.872895 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:41:50.872895 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 30 00:41:50.872895 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 30 00:41:50.872895 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 30 00:41:50.872895 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Oct 30 00:41:50.872895 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:41:50.872895 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Oct 30 00:41:50.872895 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:41:50.872895 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:41:50.872895 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:41:50.874119 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:41:50.874119 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:41:50.874119 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:41:50.874119 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:41:50.874119 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 30 00:41:50.874119 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:41:50.874119 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 30 00:41:50.874119 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Oct 30 00:41:50.874119 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:41:50.874119 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Oct 30 00:41:50.874119 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:41:50.874119 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:41:50.874119 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:41:50.874119 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:41:50.874119 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:41:50.874119 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 30 00:41:50.874119 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Oct 30 00:41:50.874119 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-193c7a77-7112-4d1e-a954-48f17d69320f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:41:50.875973 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-193c7a77-7112-4d1e-a954-48f17d69320f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014924 Oct 30 00:41:50.875973 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1190 bytes} [Sun Oct 30 00:41:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 30 00:41:52.113869 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-b993b44b-53dc-43d2-b90a-0e0355e10e82 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:52.114876 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-b993b44b-53dc-43d2-b90a-0e0355e10e82 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 30 00:41:52.115274 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 21/43] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Oct 30 00:41:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:41:52.637224 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-1eb738f3-2135-4e36-b17b-12faf4401af0 admin admin] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:52.643423 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.wsgi [None req-1eb738f3-2135-4e36-b17b-12faf4401af0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 30 00:41:52.645001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-1eb738f3-2135-4e36-b17b-12faf4401af0 admin admin] Request method failure captured: Oct 30 00:41:52.645001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 30 00:41:52.645001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Accept: application/json Oct 30 00:41:52.645001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Accept-Encoding: gzip, deflate Oct 30 00:41:52.645001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Connection: keep-alive Oct 30 00:41:52.645001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Content-Length: 0 Oct 30 00:41:52.645001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Host: 10.222.0.36 Oct 30 00:41:52.645001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Openstack-Api-Version: compute 2.92 Oct 30 00:41:52.645001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Openstack-System-Scope: None Oct 30 00:41:52.645001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: User-Agent: python-novaclient Oct 30 00:41:52.645001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Auth-Token: gAAAAABjXchQvf2GMhmRyioIoJsEqmuGdHkSxd60K9pyU6d0j_FJcA5AmsKvZdIcs3gcNEB_h-MxhNHpNq1C3_uO73y3SigJp3-k1bfCqWjOL8y8gLd6NrDGmK6vXOFNG94vpdo8Hhl3Dwh1W2c6dHBFFA4HXY1W1nfP2t_SQMSWgvgj_2y_2mI Oct 30 00:41:52.645001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Domain-Id: None Oct 30 00:41:52.645001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Domain-Name: None Oct 30 00:41:52.645001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Identity-Status: Confirmed Oct 30 00:41:52.645001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Is-Admin-Project: True Oct 30 00:41:52.645001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Openstack-Nova-Api-Version: 2.92 Oct 30 00:41:52.645001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Project-Domain-Id: default Oct 30 00:41:52.645001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Project-Domain-Name: Default Oct 30 00:41:52.645001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Project-Id: 3c2609b991ac4a86bca190e144b13290 Oct 30 00:41:52.645001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Project-Name: admin Oct 30 00:41:52.645001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Role: member,reader,admin Oct 30 00:41:52.645001 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Roles: member,reader,admin Oct 30 00:41:52.646330 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3c2609b991ac4a86bca190e144b13290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c2609b991ac4a86bca190e144b13290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3c2609b991ac4a86bca190e144b13290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c2609b991ac4a86bca190e144b13290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:41:52.646330 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Tenant: admin Oct 30 00:41:52.646330 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Tenant-Id: 3c2609b991ac4a86bca190e144b13290 Oct 30 00:41:52.646330 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Tenant-Name: admin Oct 30 00:41:52.646330 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-User: admin Oct 30 00:41:52.646330 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-User-Domain-Id: default Oct 30 00:41:52.646330 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-User-Domain-Name: Default Oct 30 00:41:52.646330 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-User-Id: 245a44aa1d7f43fcad2e727557036aab Oct 30 00:41:52.646330 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-User-Name: admin Oct 30 00:41:52.646330 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: method: > Oct 30 00:41:52.646330 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: exception: Flavor 84 could not be found. Oct 30 00:41:52.646330 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: action_args: {'id': '84'} Oct 30 00:41:52.646330 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:41:52.646330 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:41:52.647136 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 30 00:41:52.647136 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 30 00:41:52.647136 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 30 00:41:52.647136 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 30 00:41:52.647136 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 00:41:52.647136 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 00:41:52.647136 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 30 00:41:52.647136 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 30 00:41:52.647136 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 30 00:41:52.647136 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:41:52.647136 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 30 00:41:52.647136 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 30 00:41:52.647136 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 30 00:41:52.647136 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Oct 30 00:41:52.647136 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:41:52.647136 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Oct 30 00:41:52.647136 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:41:52.647136 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:41:52.647136 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:41:52.648657 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:41:52.648657 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:41:52.648657 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:41:52.648657 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:41:52.648657 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 30 00:41:52.648657 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:41:52.648657 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 30 00:41:52.648657 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Oct 30 00:41:52.648657 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:41:52.648657 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Oct 30 00:41:52.648657 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:41:52.648657 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:41:52.648657 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:41:52.648657 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:41:52.648657 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:41:52.648657 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 30 00:41:52.648657 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Oct 30 00:41:52.648657 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-1eb738f3-2135-4e36-b17b-12faf4401af0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:41:52.649946 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-1eb738f3-2135-4e36-b17b-12faf4401af0 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.393962 Oct 30 00:41:52.649946 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 23/44] 10.222.0.36 () {60 vars in 1190 bytes} [Sun Oct 30 00:41:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 30 00:41:52.656222 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-72b12468-38f4-473f-bfe9-102de840dbd2 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:52.671111 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-72b12468-38f4-473f-bfe9-102de840dbd2 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018624 Oct 30 00:41:52.671654 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 22/45] 10.222.0.36 () {60 vars in 1210 bytes} [Sun Oct 30 00:41:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:41:52.681559 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-2b126aef-38b3-4acc-b8fd-36279413d76b admin admin] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:52.698883 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-2b126aef-38b3-4acc-b8fd-36279413d76b admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021094 Oct 30 00:41:52.699419 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1210 bytes} [Sun Oct 30 00:41:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:41:52.709280 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-8b0a70af-e0c2-4564-babf-5e70909f6053 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:52.714227 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.wsgi [None req-8b0a70af-e0c2-4564-babf-5e70909f6053 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 30 00:41:52.715733 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-8b0a70af-e0c2-4564-babf-5e70909f6053 admin admin] Request method failure captured: Oct 30 00:41:52.715733 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 30 00:41:52.715733 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Accept: application/json Oct 30 00:41:52.715733 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Accept-Encoding: gzip, deflate Oct 30 00:41:52.715733 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Connection: keep-alive Oct 30 00:41:52.715733 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Content-Length: 0 Oct 30 00:41:52.715733 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Host: 10.222.0.36 Oct 30 00:41:52.715733 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Openstack-Api-Version: compute 2.92 Oct 30 00:41:52.715733 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Openstack-System-Scope: None Oct 30 00:41:52.715733 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: User-Agent: python-novaclient Oct 30 00:41:52.715733 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Auth-Token: gAAAAABjXchQvf2GMhmRyioIoJsEqmuGdHkSxd60K9pyU6d0j_FJcA5AmsKvZdIcs3gcNEB_h-MxhNHpNq1C3_uO73y3SigJp3-k1bfCqWjOL8y8gLd6NrDGmK6vXOFNG94vpdo8Hhl3Dwh1W2c6dHBFFA4HXY1W1nfP2t_SQMSWgvgj_2y_2mI Oct 30 00:41:52.715733 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Domain-Id: None Oct 30 00:41:52.715733 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Domain-Name: None Oct 30 00:41:52.715733 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Identity-Status: Confirmed Oct 30 00:41:52.715733 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Is-Admin-Project: True Oct 30 00:41:52.715733 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Openstack-Nova-Api-Version: 2.92 Oct 30 00:41:52.715733 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Project-Domain-Id: default Oct 30 00:41:52.715733 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Project-Domain-Name: Default Oct 30 00:41:52.715733 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Project-Id: 3c2609b991ac4a86bca190e144b13290 Oct 30 00:41:52.715733 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Project-Name: admin Oct 30 00:41:52.715733 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Role: member,reader,admin Oct 30 00:41:52.715733 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Roles: member,reader,admin Oct 30 00:41:52.717413 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3c2609b991ac4a86bca190e144b13290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c2609b991ac4a86bca190e144b13290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3c2609b991ac4a86bca190e144b13290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c2609b991ac4a86bca190e144b13290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:41:52.717413 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Tenant: admin Oct 30 00:41:52.717413 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Tenant-Id: 3c2609b991ac4a86bca190e144b13290 Oct 30 00:41:52.717413 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Tenant-Name: admin Oct 30 00:41:52.717413 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-User: admin Oct 30 00:41:52.717413 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-User-Domain-Id: default Oct 30 00:41:52.717413 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-User-Domain-Name: Default Oct 30 00:41:52.717413 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-User-Id: 245a44aa1d7f43fcad2e727557036aab Oct 30 00:41:52.717413 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-User-Name: admin Oct 30 00:41:52.717413 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: method: > Oct 30 00:41:52.717413 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: exception: Flavor 84 could not be found. Oct 30 00:41:52.717413 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: action_args: {'id': '84'} Oct 30 00:41:52.717413 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:41:52.717413 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:41:52.718362 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 30 00:41:52.718362 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 30 00:41:52.718362 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 30 00:41:52.718362 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 30 00:41:52.718362 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 00:41:52.718362 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 00:41:52.718362 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 30 00:41:52.718362 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 30 00:41:52.718362 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 30 00:41:52.718362 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:41:52.718362 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 30 00:41:52.718362 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 30 00:41:52.718362 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 30 00:41:52.718362 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Oct 30 00:41:52.718362 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:41:52.718362 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Oct 30 00:41:52.718362 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:41:52.718362 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:41:52.718362 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:41:52.719944 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:41:52.719944 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:41:52.719944 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:41:52.719944 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:41:52.719944 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 30 00:41:52.719944 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:41:52.719944 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 30 00:41:52.719944 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Oct 30 00:41:52.719944 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:41:52.719944 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Oct 30 00:41:52.719944 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:41:52.719944 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:41:52.719944 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:41:52.719944 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:41:52.719944 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:41:52.719944 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 30 00:41:52.719944 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Oct 30 00:41:52.719944 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-8b0a70af-e0c2-4564-babf-5e70909f6053 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:41:52.721289 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-8b0a70af-e0c2-4564-babf-5e70909f6053 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011356 Oct 30 00:41:52.721289 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 23/47] 10.222.0.36 () {60 vars in 1190 bytes} [Sun Oct 30 00:41:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 30 00:41:53.967746 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-2b126aef-38b3-4acc-b8fd-36279413d76b admin admin] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:53.969372 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-2b126aef-38b3-4acc-b8fd-36279413d76b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 30 00:41:53.969807 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 25/48] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Oct 30 00:41:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:41:54.494799 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-a23586a6-ebd7-4bb4-abea-1ffdbb4ed777 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:54.500712 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.wsgi [None req-a23586a6-ebd7-4bb4-abea-1ffdbb4ed777 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 30 00:41:54.502198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-a23586a6-ebd7-4bb4-abea-1ffdbb4ed777 admin admin] Request method failure captured: Oct 30 00:41:54.502198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 30 00:41:54.502198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Accept: application/json Oct 30 00:41:54.502198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Accept-Encoding: gzip, deflate Oct 30 00:41:54.502198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Connection: keep-alive Oct 30 00:41:54.502198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Content-Length: 0 Oct 30 00:41:54.502198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Host: 10.222.0.36 Oct 30 00:41:54.502198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Openstack-Api-Version: compute 2.92 Oct 30 00:41:54.502198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Openstack-System-Scope: None Oct 30 00:41:54.502198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: User-Agent: python-novaclient Oct 30 00:41:54.502198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Auth-Token: gAAAAABjXchRYGp6hWDT8QzLHhduTOiyZTZlCTLG-x-XkTnfUInHGYn4Bk9s2EuMUe3G5axEo_jsQilg1MkBtiS7Jd1zWokFVhmZlKz3l1MC5ebhFdVkM-L_LuU71bs0Y8eifTBDw9ThJR4ZTc3DznuprGfl4ziN22-MwKfLTz1qLoKWYUyrLeU Oct 30 00:41:54.502198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Domain-Id: None Oct 30 00:41:54.502198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Domain-Name: None Oct 30 00:41:54.502198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Identity-Status: Confirmed Oct 30 00:41:54.502198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Is-Admin-Project: True Oct 30 00:41:54.502198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Openstack-Nova-Api-Version: 2.92 Oct 30 00:41:54.502198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Project-Domain-Id: default Oct 30 00:41:54.502198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Project-Domain-Name: Default Oct 30 00:41:54.502198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Project-Id: 3c2609b991ac4a86bca190e144b13290 Oct 30 00:41:54.502198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Project-Name: admin Oct 30 00:41:54.502198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Role: member,reader,admin Oct 30 00:41:54.502198 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Roles: member,reader,admin Oct 30 00:41:54.503820 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3c2609b991ac4a86bca190e144b13290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c2609b991ac4a86bca190e144b13290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3c2609b991ac4a86bca190e144b13290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c2609b991ac4a86bca190e144b13290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:41:54.503820 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Tenant: admin Oct 30 00:41:54.503820 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Tenant-Id: 3c2609b991ac4a86bca190e144b13290 Oct 30 00:41:54.503820 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-Tenant-Name: admin Oct 30 00:41:54.503820 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-User: admin Oct 30 00:41:54.503820 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-User-Domain-Id: default Oct 30 00:41:54.503820 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-User-Domain-Name: Default Oct 30 00:41:54.503820 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-User-Id: 245a44aa1d7f43fcad2e727557036aab Oct 30 00:41:54.503820 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: X-User-Name: admin Oct 30 00:41:54.503820 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: method: > Oct 30 00:41:54.503820 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: exception: Flavor 451 could not be found. Oct 30 00:41:54.503820 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: action_args: {'id': '451'} Oct 30 00:41:54.503820 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:41:54.503820 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:41:54.504781 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 30 00:41:54.504781 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 30 00:41:54.504781 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 30 00:41:54.504781 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 30 00:41:54.504781 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 00:41:54.504781 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 00:41:54.504781 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 30 00:41:54.504781 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 30 00:41:54.504781 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 30 00:41:54.504781 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:41:54.504781 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 30 00:41:54.504781 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 30 00:41:54.504781 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 30 00:41:54.504781 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Oct 30 00:41:54.504781 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:41:54.504781 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Oct 30 00:41:54.504781 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:41:54.504781 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:41:54.504781 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:41:54.505915 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:41:54.505915 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:41:54.505915 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:41:54.505915 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:41:54.505915 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 30 00:41:54.505915 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:41:54.505915 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 30 00:41:54.505915 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Oct 30 00:41:54.505915 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:41:54.505915 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Oct 30 00:41:54.505915 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:41:54.505915 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:41:54.505915 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:41:54.505915 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:41:54.505915 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:41:54.505915 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 30 00:41:54.505915 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: ERROR nova.api.openstack.wsgi Oct 30 00:41:54.505915 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-a23586a6-ebd7-4bb4-abea-1ffdbb4ed777 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110518) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:41:54.506912 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-a23586a6-ebd7-4bb4-abea-1ffdbb4ed777 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.397247 Oct 30 00:41:54.506912 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 24/49] 10.222.0.36 () {60 vars in 1193 bytes} [Sun Oct 30 00:41:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 30 00:41:54.513435 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-ac75bdcf-51df-4de4-9f03-fe92cbc933ae admin admin] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:54.528868 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-ac75bdcf-51df-4de4-9f03-fe92cbc933ae admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019120 Oct 30 00:41:54.529855 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 26/50] 10.222.0.36 () {60 vars in 1210 bytes} [Sun Oct 30 00:41:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:41:54.540170 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-f4f75540-2ccd-461a-ba6b-d07895914d71 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:54.555583 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-f4f75540-2ccd-461a-ba6b-d07895914d71 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019033 Oct 30 00:41:54.556164 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 25/51] 10.222.0.36 () {60 vars in 1210 bytes} [Sun Oct 30 00:41:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:41:54.566030 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-d1453024-f0d3-4723-96be-131d4a8b00ff admin admin] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:54.571213 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.wsgi [None req-d1453024-f0d3-4723-96be-131d4a8b00ff admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 30 00:41:54.572793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-d1453024-f0d3-4723-96be-131d4a8b00ff admin admin] Request method failure captured: Oct 30 00:41:54.572793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 30 00:41:54.572793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Accept: application/json Oct 30 00:41:54.572793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Accept-Encoding: gzip, deflate Oct 30 00:41:54.572793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Connection: keep-alive Oct 30 00:41:54.572793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Content-Length: 0 Oct 30 00:41:54.572793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Host: 10.222.0.36 Oct 30 00:41:54.572793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Openstack-Api-Version: compute 2.92 Oct 30 00:41:54.572793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Openstack-System-Scope: None Oct 30 00:41:54.572793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: User-Agent: python-novaclient Oct 30 00:41:54.572793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Auth-Token: gAAAAABjXchRYGp6hWDT8QzLHhduTOiyZTZlCTLG-x-XkTnfUInHGYn4Bk9s2EuMUe3G5axEo_jsQilg1MkBtiS7Jd1zWokFVhmZlKz3l1MC5ebhFdVkM-L_LuU71bs0Y8eifTBDw9ThJR4ZTc3DznuprGfl4ziN22-MwKfLTz1qLoKWYUyrLeU Oct 30 00:41:54.572793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Domain-Id: None Oct 30 00:41:54.572793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Domain-Name: None Oct 30 00:41:54.572793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Identity-Status: Confirmed Oct 30 00:41:54.572793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Is-Admin-Project: True Oct 30 00:41:54.572793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Openstack-Nova-Api-Version: 2.92 Oct 30 00:41:54.572793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Project-Domain-Id: default Oct 30 00:41:54.572793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Project-Domain-Name: Default Oct 30 00:41:54.572793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Project-Id: 3c2609b991ac4a86bca190e144b13290 Oct 30 00:41:54.572793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Project-Name: admin Oct 30 00:41:54.572793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Role: member,reader,admin Oct 30 00:41:54.572793 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Roles: member,reader,admin Oct 30 00:41:54.574421 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3c2609b991ac4a86bca190e144b13290"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c2609b991ac4a86bca190e144b13290"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3c2609b991ac4a86bca190e144b13290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3c2609b991ac4a86bca190e144b13290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:41:54.574421 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Tenant: admin Oct 30 00:41:54.574421 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Tenant-Id: 3c2609b991ac4a86bca190e144b13290 Oct 30 00:41:54.574421 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-Tenant-Name: admin Oct 30 00:41:54.574421 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-User: admin Oct 30 00:41:54.574421 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-User-Domain-Id: default Oct 30 00:41:54.574421 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-User-Domain-Name: Default Oct 30 00:41:54.574421 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-User-Id: 245a44aa1d7f43fcad2e727557036aab Oct 30 00:41:54.574421 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: X-User-Name: admin Oct 30 00:41:54.574421 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: method: > Oct 30 00:41:54.574421 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: exception: Flavor 451 could not be found. Oct 30 00:41:54.574421 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: action_args: {'id': '451'} Oct 30 00:41:54.574421 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:41:54.574421 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:41:54.575257 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 30 00:41:54.575257 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 30 00:41:54.575257 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 30 00:41:54.575257 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 30 00:41:54.575257 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 00:41:54.575257 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 00:41:54.575257 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 30 00:41:54.575257 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 30 00:41:54.575257 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 30 00:41:54.575257 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:41:54.575257 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 30 00:41:54.575257 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 30 00:41:54.575257 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 30 00:41:54.575257 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Oct 30 00:41:54.575257 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:41:54.575257 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Oct 30 00:41:54.575257 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:41:54.575257 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:41:54.575257 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:41:54.576327 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:41:54.576327 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:41:54.576327 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:41:54.576327 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:41:54.576327 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 30 00:41:54.576327 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:41:54.576327 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 30 00:41:54.576327 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Oct 30 00:41:54.576327 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:41:54.576327 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Oct 30 00:41:54.576327 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:41:54.576327 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:41:54.576327 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:41:54.576327 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:41:54.576327 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:41:54.576327 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 30 00:41:54.576327 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: ERROR nova.api.openstack.wsgi Oct 30 00:41:54.576327 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-d1453024-f0d3-4723-96be-131d4a8b00ff admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110517) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:41:54.577370 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-d1453024-f0d3-4723-96be-131d4a8b00ff admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011891 Oct 30 00:41:54.577370 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 27/52] 10.222.0.36 () {60 vars in 1193 bytes} [Sun Oct 30 00:41:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 30 00:41:55.795872 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-f4f75540-2ccd-461a-ba6b-d07895914d71 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:55.797025 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-f4f75540-2ccd-461a-ba6b-d07895914d71 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 30 00:41:55.797872 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 26/53] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Oct 30 00:41:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:41:56.324227 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-75326066-8a2b-43c9-89df-f7c55346a683 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:41:56.343467 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-75326066-8a2b-43c9-89df-f7c55346a683 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.406095 Oct 30 00:41:56.344160 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 28/54] 10.222.0.36 () {64 vars in 1235 bytes} [Sun Oct 30 00:41:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:41:57.557669 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-f4f75540-2ccd-461a-ba6b-d07895914d71 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:57.558665 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-f4f75540-2ccd-461a-ba6b-d07895914d71 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Oct 30 00:41:57.559051 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Oct 30 00:41:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:41:58.095620 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-e83cd1bb-6165-4a33-ad46-3beb174ea85b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:41:58.114619 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-e83cd1bb-6165-4a33-ad46-3beb174ea85b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.419153 Oct 30 00:41:58.115171 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 29/56] 10.222.0.36 () {64 vars in 1235 bytes} [Sun Oct 30 00:41:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:41:59.328109 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-f4f75540-2ccd-461a-ba6b-d07895914d71 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:41:59.329843 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-f4f75540-2ccd-461a-ba6b-d07895914d71 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002167 Oct 30 00:41:59.330241 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 28/57] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Oct 30 00:41:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:41:59.854197 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-dba39f8c-4950-40ee-821f-90697d810c6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:41:59.874190 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-dba39f8c-4950-40ee-821f-90697d810c6c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.406141 Oct 30 00:41:59.874736 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 30/58] 10.222.0.36 () {64 vars in 1235 bytes} [Sun Oct 30 00:41:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:42:01.083972 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-f4f75540-2ccd-461a-ba6b-d07895914d71 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:42:01.085005 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-f4f75540-2ccd-461a-ba6b-d07895914d71 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 30 00:42:01.085423 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 29/59] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Oct 30 00:42:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:42:01.611106 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-107866cb-9ded-4c8f-9f20-eaba12b8a111 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:42:01.629487 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-107866cb-9ded-4c8f-9f20-eaba12b8a111 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.405499 Oct 30 00:42:01.630045 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 31/60] 10.222.0.36 () {64 vars in 1235 bytes} [Sun Oct 30 00:42:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:42:02.834979 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-f4f75540-2ccd-461a-ba6b-d07895914d71 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:42:02.835985 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-f4f75540-2ccd-461a-ba6b-d07895914d71 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Oct 30 00:42:02.836414 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 30/61] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Oct 30 00:42:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:42:03.361136 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-f2f6478b-1c72-48c2-9a61-f1a432c0a230 admin admin] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:42:03.381749 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-f2f6478b-1c72-48c2-9a61-f1a432c0a230 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.406533 Oct 30 00:42:03.382282 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 32/62] 10.222.0.36 () {60 vars in 1202 bytes} [Sun Oct 30 00:42:02 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:43:00.596031 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-f4f75540-2ccd-461a-ba6b-d07895914d71 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:43:00.597115 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-f4f75540-2ccd-461a-ba6b-d07895914d71 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 30 00:43:00.597593 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 31/63] 10.222.0.36 () {54 vars in 931 bytes} [Sun Oct 30 00:43:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:43:00.608577 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG dbcounter [-] [110517] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=110517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:01.004157 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-d4afd908-49a4-4fb1-827f-e3f6d0ca2778 admin admin] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:43:01.025260 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-d4afd908-49a4-4fb1-827f-e3f6d0ca2778 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.421071 Oct 30 00:43:01.025794 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 33/64] 10.222.0.36 () {60 vars in 1292 bytes} [Sun Oct 30 00:43:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:43:01.047046 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG dbcounter [-] [110518] Writing DB stats nova_api:SELECT=14 {{(pid=110518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:43:01.050795 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-25030333-eee9-4012-aa43-d93987abb200 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:43:01.058216 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-25030333-eee9-4012-aa43-d93987abb200 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012575 Oct 30 00:43:01.058727 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 32/65] 10.222.0.36 () {60 vars in 1283 bytes} [Sun Oct 30 00:43:01 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:43:01.070915 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-eadb2d0b-637a-40fe-a48b-2cae4a4dbaf3 admin admin] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:43:01.078061 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-eadb2d0b-637a-40fe-a48b-2cae4a4dbaf3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010667 Oct 30 00:43:01.078571 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 34/66] 10.222.0.36 () {60 vars in 1286 bytes} [Sun Oct 30 00:43:01 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:43:01.090235 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-f2dba65c-99d9-401b-8137-58b5fca0e3a5 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:43:01.097892 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-f2dba65c-99d9-401b-8137-58b5fca0e3a5 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010735 Oct 30 00:43:01.098423 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 33/67] 10.222.0.36 () {60 vars in 1286 bytes} [Sun Oct 30 00:43:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:43:01.109623 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-b439bb8e-dee4-4d95-ac0c-24ef656529e8 admin admin] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:43:01.117569 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-b439bb8e-dee4-4d95-ac0c-24ef656529e8 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011437 Oct 30 00:43:01.118075 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 35/68] 10.222.0.36 () {60 vars in 1283 bytes} [Sun Oct 30 00:43:01 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:46:09.478236 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-f2dba65c-99d9-401b-8137-58b5fca0e3a5 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:46:09.479274 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-f2dba65c-99d9-401b-8137-58b5fca0e3a5 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 30 00:46:09.479669 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 34/69] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Oct 30 00:46:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:46:09.622986 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG dbcounter [-] [110517] Writing DB stats nova_api:SELECT=6 {{(pid=110517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:09.781996 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-69ab76f9-8a23-42f8-95dd-371807b8933a admin admin] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:46:09.786796 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-69ab76f9-8a23-42f8-95dd-371807b8933a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:46:09.787338 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-69ab76f9-8a23-42f8-95dd-371807b8933a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:46:09.787948 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-69ab76f9-8a23-42f8-95dd-371807b8933a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:46:09.788512 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-69ab76f9-8a23-42f8-95dd-371807b8933a admin admin] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:46:09.788960 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-69ab76f9-8a23-42f8-95dd-371807b8933a admin admin] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:46:09.789378 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-69ab76f9-8a23-42f8-95dd-371807b8933a admin admin] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:46:09.823186 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-69ab76f9-8a23-42f8-95dd-371807b8933a admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.201423 Oct 30 00:46:09.823750 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 36/70] 10.222.0.36 () {60 vars in 1193 bytes} [Sun Oct 30 00:46:09 2022] GET /compute/v2.1/os-services => generated 791 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:46:10.893565 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-f2dba65c-99d9-401b-8137-58b5fca0e3a5 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:46:10.894584 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-f2dba65c-99d9-401b-8137-58b5fca0e3a5 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Oct 30 00:46:10.894991 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 35/71] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Oct 30 00:46:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:46:11.089788 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-ec04662a-3d88-4e1c-8b83-f1f661bcf994 admin admin] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:46:11.093185 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-ec04662a-3d88-4e1c-8b83-f1f661bcf994 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:46:11.093653 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-ec04662a-3d88-4e1c-8b83-f1f661bcf994 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:46:11.094074 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-ec04662a-3d88-4e1c-8b83-f1f661bcf994 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:46:11.094782 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-ec04662a-3d88-4e1c-8b83-f1f661bcf994 admin admin] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:46:11.095222 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-ec04662a-3d88-4e1c-8b83-f1f661bcf994 admin admin] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:46:11.095634 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-ec04662a-3d88-4e1c-8b83-f1f661bcf994 admin admin] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:46:11.117041 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-ec04662a-3d88-4e1c-8b83-f1f661bcf994 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.082496 Oct 30 00:46:11.117604 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 37/72] 10.222.0.36 () {60 vars in 1193 bytes} [Sun Oct 30 00:46:11 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:46:22.600530 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-f2dba65c-99d9-401b-8137-58b5fca0e3a5 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:46:22.601535 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-f2dba65c-99d9-401b-8137-58b5fca0e3a5 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 30 00:46:22.601929 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 36/73] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Oct 30 00:46:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 00:46:22.749503 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG dbcounter [-] [110517] Writing DB stats nova_cell0:SELECT=4 {{(pid=110517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:22.750222 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG dbcounter [-] [110517] Writing DB stats nova_cell1:SELECT=4 {{(pid=110517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:22.750833 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG dbcounter [-] [110517] Writing DB stats nova_api:SELECT=8 {{(pid=110517) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:46:22.799808 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-02accaec-f460-4dac-8c51-9d83f9de9329 admin admin] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:46:22.803850 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-02accaec-f460-4dac-8c51-9d83f9de9329 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:46:22.804346 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-02accaec-f460-4dac-8c51-9d83f9de9329 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:46:22.804774 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-02accaec-f460-4dac-8c51-9d83f9de9329 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:46:22.805480 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-02accaec-f460-4dac-8c51-9d83f9de9329 admin admin] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:46:22.805917 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-02accaec-f460-4dac-8c51-9d83f9de9329 admin admin] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:46:22.806328 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-02accaec-f460-4dac-8c51-9d83f9de9329 admin admin] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:46:22.831593 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-02accaec-f460-4dac-8c51-9d83f9de9329 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.086556 Oct 30 00:46:22.832074 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 38/74] 10.222.0.36 () {60 vars in 1193 bytes} [Sun Oct 30 00:46:22 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:46:23.903102 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG nova.api.openstack.wsgi [None req-f2dba65c-99d9-401b-8137-58b5fca0e3a5 admin admin] Calling method '>' {{(pid=110518) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:46:23.904140 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: INFO nova.api.openstack.requestlog [None req-f2dba65c-99d9-401b-8137-58b5fca0e3a5 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 30 00:46:23.904544 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: [pid: 110518|app: 0|req: 37/75] 10.222.0.36 () {56 vars in 1074 bytes} [Sun Oct 30 00:46:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:46:24.094411 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG nova.api.openstack.wsgi [None req-fa86b599-f2ce-45d5-a9f5-b3c3ebbe3cd9 admin admin] Calling method '>' {{(pid=110517) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:46:24.097845 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-fa86b599-f2ce-45d5-a9f5-b3c3ebbe3cd9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:46:24.098390 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-fa86b599-f2ce-45d5-a9f5-b3c3ebbe3cd9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:46:24.098881 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-fa86b599-f2ce-45d5-a9f5-b3c3ebbe3cd9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:46:24.099663 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-fa86b599-f2ce-45d5-a9f5-b3c3ebbe3cd9 admin admin] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:46:24.100142 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-fa86b599-f2ce-45d5-a9f5-b3c3ebbe3cd9 admin admin] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:46:24.100567 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: DEBUG oslo_concurrency.lockutils [None req-fa86b599-f2ce-45d5-a9f5-b3c3ebbe3cd9 admin admin] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110517) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:46:24.122722 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: INFO nova.api.openstack.requestlog [None req-fa86b599-f2ce-45d5-a9f5-b3c3ebbe3cd9 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.080410 Oct 30 00:46:24.123212 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: [pid: 110517|app: 0|req: 39/76] 10.222.0.36 () {60 vars in 1193 bytes} [Sun Oct 30 00:46:24 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:47:23.020958 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: Sun Oct 30 00:47:23 2022 - graceful shutdown triggered... Oct 30 00:47:23.020387 dv-cinder-861491-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 30 00:47:23.022007 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: Gracefully killing worker 2 (pid: 110518)... Oct 30 00:47:23.022399 dv-cinder-861491-6-iscsi devstack@n-api.service[110517]: Gracefully killing worker 1 (pid: 110517)... Oct 30 00:47:23.151042 dv-cinder-861491-6-iscsi devstack@n-api.service[110518]: DEBUG dbcounter [-] [110518] Writing DB stats nova_api:SELECT=4 {{(pid=110518) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:47:24.021413 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: worker 1 buried after 1 seconds Oct 30 00:47:24.021413 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: worker 2 buried after 1 seconds Oct 30 00:47:24.021413 dv-cinder-861491-6-iscsi devstack@n-api.service[110516]: goodbye to uWSGI. Oct 30 00:47:24.022978 dv-cinder-861491-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 30 00:47:24.023536 dv-cinder-861491-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 30 00:47:24.026277 dv-cinder-861491-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 30 00:47:24.041122 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 30 00:47:24.043106 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 30 00:47:24 2022] *** Oct 30 00:47:24.043226 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 30 00:47:24.043226 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 30 00:47:24.043226 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: nodename: dv-cinder-861491-6-iscsi Oct 30 00:47:24.043226 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: machine: x86_64 Oct 30 00:47:24.043226 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: clock source: unix Oct 30 00:47:24.043226 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: pcre jit disabled Oct 30 00:47:24.043226 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: detected number of CPU cores: 4 Oct 30 00:47:24.043226 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: current working directory: / Oct 30 00:47:24.043226 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: detected binary path: /usr/bin/uwsgi-core Oct 30 00:47:24.043226 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: your processes number limit is 47680 Oct 30 00:47:24.043226 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: your memory page size is 4096 bytes Oct 30 00:47:24.043226 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: detected max file descriptor number: 2048 Oct 30 00:47:24.043226 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: lock engine: pthread robust mutexes Oct 30 00:47:24.044190 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: thunder lock: enabled Oct 30 00:47:24.044190 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 30 00:47:24.044190 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 30 00:47:24.084205 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: Python main interpreter initialized at 0x556a5e9279c0 Oct 30 00:47:24.084205 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: python threads support enabled Oct 30 00:47:24.084205 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: your server socket listen backlog is limited to 100 connections Oct 30 00:47:24.084205 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: your mercy for graceful operations on workers is 90 seconds Oct 30 00:47:24.084665 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: mapped 403077 bytes (393 KB) for 2 cores Oct 30 00:47:24.084665 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: *** Operational MODE: preforking *** Oct 30 00:47:24.084911 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: *** uWSGI is running in multiple interpreter mode *** Oct 30 00:47:24.084911 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: spawned uWSGI master process (pid: 125535) Oct 30 00:47:24.085125 dv-cinder-861491-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 30 00:47:24.085750 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: spawned uWSGI worker 1 (pid: 125553, cores: 1) Oct 30 00:47:24.092333 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: spawned uWSGI worker 2 (pid: 125554, cores: 1) Oct 30 00:47:24.092333 dv-cinder-861491-6-iscsi devstack@n-api.service[125535]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 30 00:47:24.757272 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 30 00:47:24.757911 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 30 00:47:26.003909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 00:47:26.003909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: from cryptography.utils import int_from_bytes Oct 30 00:47:26.004981 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 00:47:26.004981 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: from cryptography.utils import int_from_bytes Oct 30 00:47:26.038732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 00:47:26.038732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: from cryptography.utils import int_from_bytes Oct 30 00:47:26.039343 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 30 00:47:26.039343 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: from cryptography.utils import int_from_bytes Oct 30 00:47:28.469125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 30 00:47:28.469676 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 30 00:47:28.470026 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 30 00:47:28.470399 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 30 00:47:28.470653 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 30 00:47:28.471045 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.471371 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.471691 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.472011 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.472387 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.472700 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.473028 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.473349 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.473674 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.473936 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.474253 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.474577 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861491-6-iscsi {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.474903 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.475206 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.475516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.475834 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.476177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.476500 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.476805 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.477314 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.479348 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.479892 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.480459 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.481077 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.481633 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.482175 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.482749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.483262 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.483710 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.484114 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.484496 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861491-6-iscsi {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.484870 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.485190 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.486042 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.486780 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.487210 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.487538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.487869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.488227 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.488541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.488974 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.489290 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.489619 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.489946 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.490253 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.490565 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.490876 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.491200 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.491510 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.491818 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.492068 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.492402 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.492726 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.493047 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.493369 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.493627 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.493873 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.494204 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.494516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.494823 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.495133 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.495440 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.495745 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.496050 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.496384 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.496693 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.496999 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.497317 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.497640 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.497960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.498267 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.498587 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.498995 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.499247 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.499555 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.499898 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.500254 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.500564 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.500882 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.501858 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.502277 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.502594 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.502899 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.503217 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.503557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.503863 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.504136 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.504443 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.504747 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.505064 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.505369 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.505675 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.505979 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.506276 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.506579 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.506882 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.507185 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.507486 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.507793 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.508131 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.508421 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.508724 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.509025 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.509324 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.509647 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.509960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.510266 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.510570 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.510875 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.511358 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.511526 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.511775 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.512108 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.512425 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.512731 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.513032 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.513349 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.513651 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.513952 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.514270 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.514568 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.514873 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.515185 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.515489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.515789 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.516111 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.516415 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.516762 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.517260 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.517678 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.517985 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.518284 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.518602 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.518922 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.519234 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.520148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.520464 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.520787 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.521607 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.521947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.522295 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.522616 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.522952 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.523283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.523603 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.523913 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.524251 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.524580 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.524894 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.525206 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.525528 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.525832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.526147 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.526478 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.526794 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.527110 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.527429 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.527739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.528054 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.528411 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.528736 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.529047 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.529410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.529730 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.530048 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.530367 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.530690 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.530999 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.531308 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.531615 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.531958 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.532312 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.532706 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.533262 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.533635 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.533911 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.534229 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.534545 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.534863 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.535179 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.535485 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.535837 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.536164 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.536491 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.536812 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.537125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.537438 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.537749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.538061 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.538376 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.538678 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.538981 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.539285 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.539591 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.539892 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.540238 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.540564 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.540868 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.541203 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.541509 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.541815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.542124 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.542428 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.542778 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.543050 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.543344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.543644 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.543967 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.544302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.544608 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.544930 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.547812 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.547812 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.547812 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.547812 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.547812 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.547812 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.547812 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.547812 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.549979 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.549979 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.549979 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.549979 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.549979 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.549979 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.550919 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.550919 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.550919 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.550919 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.551465 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.551609 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.551797 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.552117 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.552426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.552731 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.553036 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.553407 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.553639 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.554362 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.554362 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.554533 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.554828 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.555134 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.555473 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.555779 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.556140 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.556480 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.556798 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.557122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.557434 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.557967 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.558141 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.558353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.558748 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.559020 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.559282 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.559594 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.559912 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.560215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 30 00:47:28.560803 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.560958 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 30 00:47:28.561119 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.561119 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.561423 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 30 00:47:28.561581 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.561734 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 30 00:47:28.561889 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.562041 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 30 00:47:28.562187 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.562341 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.562486 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.562631 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.562781 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.562952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.563186 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.563356 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.563700 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.564483 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.564683 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.564832 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.564983 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.565149 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.565296 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.565717 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.566009 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.566009 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.566964 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.567115 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.567268 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.567427 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.567572 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.567727 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.567922 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-861491-6-iscsi {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.568299 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.568474 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.568629 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.568799 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.569045 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.569293 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.569444 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.569590 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.569753 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.569957 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.570174 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.570346 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.570506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.570659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.570821 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.571053 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.571237 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.571395 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.571548 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.571704 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.571856 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.572002 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.572258 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.572545 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.572697 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.572843 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.572996 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.573169 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.573399 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.573399 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.573786 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.573937 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.574095 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.574247 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.574407 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.574624 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.574777 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.574922 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.575076 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-861491-6-iscsi {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.575236 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.575388 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.575532 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.575683 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.575828 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.575972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.576224 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.576387 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.576535 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.576679 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.576822 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.576974 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.577128 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.577315 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.577464 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.577608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.577767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.577911 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.578077 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.578465 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.578630 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.578778 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.578933 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.579208 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.579464 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.579464 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.579756 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.579997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.580187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.580347 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.580494 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.580650 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.580795 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.580939 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.581151 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.581309 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.581457 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.581601 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.581753 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.581753 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.582058 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.582214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.582359 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.582521 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.582748 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.582905 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.583060 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.583211 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.583386 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.583607 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.583778 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.583998 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.584201 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.584360 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.584514 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.584672 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.584826 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.584994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.585424 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.585695 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.585869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.586028 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.586180 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.586334 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.586487 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.586639 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.586785 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.586929 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.587095 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.587254 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.587399 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.587559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.587703 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.587848 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.587999 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.588187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.588586 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.588745 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.588892 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.589045 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.589219 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.589473 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.589473 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.589860 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.590050 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.590200 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.590354 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.590507 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.590652 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.590803 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.590957 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.591102 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.591262 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.591432 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.591597 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.591752 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.591914 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.592059 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.592227 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.592372 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.592527 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.592686 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.592923 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.593086 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.593240 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.593392 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.593548 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.593799 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.593952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.594190 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.594340 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.594492 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.594646 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.594829 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.594989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.595159 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.595344 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.595512 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.595662 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.595832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.595985 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.596189 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.596341 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.596495 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.596650 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.596804 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.596956 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.597113 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.597259 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.597402 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.597556 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.597700 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.597855 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.597998 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.598149 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.598302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.598455 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.598857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.599010 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.599155 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.599308 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.599558 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.599739 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.599979 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.600184 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.600349 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.600495 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.600653 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.600799 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.600799 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.601080 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.601225 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.601376 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.601531 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.601676 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.601821 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.601977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.602134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.602286 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.602437 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.603584 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.603772 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.604010 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.604215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.604440 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.604594 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.604747 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.604893 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.605582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.606347 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.606515 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.606671 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.606826 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.607009 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.607178 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.607452 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.607681 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.607831 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.607976 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.608200 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.608353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.608353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.608649 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.608649 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.609196 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.609342 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.609486 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.609750 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.609904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.610050 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.610252 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.610405 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.611177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.611349 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.611551 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.611812 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.611969 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.612147 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.612299 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.612459 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.612605 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.612750 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.612924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.613124 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.613272 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.613429 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.613601 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.613858 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.614036 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.614268 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.614447 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.614447 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.614824 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 30 00:47:28.614978 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.615125 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.615277 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.615432 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.615578 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.615722 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.615890 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.616038 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.616219 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.616380 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.616677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.616852 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.617007 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.617160 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.617305 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.617464 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.617610 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.617755 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.617915 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.618071 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.618336 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.618505 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.618652 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.618806 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.619223 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.620316 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.620494 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.620647 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.620820 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.620974 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.621120 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.621264 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.621553 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.621659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.621755 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.621842 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.621977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.622075 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.622171 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.622171 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.622328 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.622412 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.622495 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.622589 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.622674 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.622759 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.622850 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.622935 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.623032 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.623126 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.623219 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.623304 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.623396 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.623488 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.623580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.623679 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.623777 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.623880 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.623966 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.624051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.624181 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.624449 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.624546 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.624632 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.624789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.624880 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.624974 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.625068 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.625161 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.625254 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.625347 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.625433 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.625530 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.625617 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.625709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.625801 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.625887 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.625971 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.626097 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.626819 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.627053 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.627182 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.627279 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.627401 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.627529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.627619 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.627704 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.627797 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.627883 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.627977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.628063 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.628180 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.628269 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.628360 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.628446 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.628539 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.628627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.628718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.628805 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.628890 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.628974 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.629105 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.629372 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.629471 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.629567 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.629661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.629754 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.629850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.629937 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.630028 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.630136 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.630251 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.630401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.630505 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.630593 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.630678 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.630762 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.630846 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.630986 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.631082 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.631177 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.631263 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.631347 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.631437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.631547 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.631642 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.631729 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.631813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.631897 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.631987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.632233 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.632347 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.632436 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.632529 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.632615 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.632709 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.632797 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.632880 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.632880 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.633043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.633127 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.633224 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.633224 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.633378 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.633462 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.633545 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.633629 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.633722 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.633809 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.633896 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.633981 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.634070 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.634156 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.634248 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.634334 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.634461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.634549 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.634633 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.634726 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.634812 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.634905 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.634992 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.635084 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.635170 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.635342 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.635430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.635521 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.635606 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.635690 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.635773 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.635866 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.635951 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.636035 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.636135 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.636221 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.636317 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.636413 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.636499 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.636583 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.636674 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.636674 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.636841 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.636841 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.636979 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.637056 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.637140 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.637223 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.637318 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.637410 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.637502 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.637715 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.637806 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.637890 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.637988 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.638083 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.638169 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.638254 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.638338 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.638428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.638526 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.638613 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.638704 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.638796 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.638882 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.638976 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.639062 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.639146 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.639235 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.639335 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.639573 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.639753 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.639841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.639926 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.640019 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.640222 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.640325 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.640440 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.640524 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.640603 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.640687 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.640771 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.640861 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.640955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.641040 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.641124 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.641230 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.641317 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.641419 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.641506 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.641589 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.641692 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.641789 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.641883 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.641978 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.642071 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.642071 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.642227 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.642919 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.643023 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.643127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.643222 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.643310 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.643395 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.643481 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.643566 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.643663 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.643757 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.643879 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.644050 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.644218 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.644366 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.644540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.644700 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.644873 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.645211 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.645527 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.645809 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.645895 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.646130 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.646214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.646446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.646542 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.646755 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.646844 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.647062 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.647165 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.647367 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.647448 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.647675 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.647758 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.647988 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.648069 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.648321 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.649679 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.649780 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.649855 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.649927 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.649998 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.650083 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.650170 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.650263 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.650348 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.650432 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.650547 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.650644 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.650730 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.650821 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.650906 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.650993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.651076 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.651172 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.651257 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.651347 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.651508 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.651694 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.651858 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.652014 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.652212 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.652315 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.652464 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.652601 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.652794 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.652988 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.653094 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.653531 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.653633 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.653729 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.653814 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.653895 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.654094 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.654196 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.654399 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.654491 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.654707 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.654802 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.655014 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.655116 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.655320 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.655422 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.655621 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.655718 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.655926 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.656020 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.656259 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.656507 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.656609 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.656708 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.656851 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.656949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.657158 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.657271 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.657981 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.658085 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.658295 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.658398 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.658600 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.658827 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.658938 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.659138 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.659254 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.659463 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.659566 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.659774 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.659885 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.660104 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.660210 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.660407 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.660518 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.660708 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.660801 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.661051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.661147 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.661355 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.661463 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.661661 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.661774 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.661974 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.662067 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.662293 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.662408 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.662601 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.662694 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.662914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.663005 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.663223 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.663345 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.663532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.663626 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.663840 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.663942 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.664179 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.664288 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.664492 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.664588 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.664800 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.664916 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.665109 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.665213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.665418 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.665527 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.665726 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.665857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.666051 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.666290 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.666393 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.666624 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.666718 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.666941 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.667039 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.667247 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.667342 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.667555 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.667671 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.667865 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.667959 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.668276 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.668464 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.668594 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.668801 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.668915 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.669118 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.669211 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.669438 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.669532 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.669782 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.669892 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.670104 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.670199 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.670481 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.670578 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.670750 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.670842 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.671064 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.671158 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.671373 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.671462 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.671759 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.671869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.672525 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.672618 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.672694 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.672771 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.672846 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.672937 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.673055 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.673141 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.673307 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.673716 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.673826 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.673902 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.673991 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.674205 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.674296 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.674512 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.674594 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.674910 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.675021 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.675205 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.675323 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.675439 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.675540 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.675746 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.675848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.676057 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.676196 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.676385 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.676478 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.676683 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.676780 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.677005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.677098 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.677353 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.677459 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.677607 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.677700 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.677914 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.678024 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.678253 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.678347 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.678657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.678745 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.678893 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.679078 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.679225 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.679390 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.679570 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.679722 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.679945 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.680052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.680208 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.680400 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.680537 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.680718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.680843 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.681037 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.681151 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.681368 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.681475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.681679 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.681780 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.681990 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.682096 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.682300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.682408 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.682610 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.682703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.682913 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.683014 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.683232 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.683333 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.683538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.683642 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.683839 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.683936 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.684177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.684290 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.684485 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.684588 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.684801 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.685013 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.685117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.685365 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.685478 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.685684 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.685814 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.685990 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.686125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.686301 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.686483 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.686634 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.686786 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.686943 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.687093 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.687249 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.687420 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.687557 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.687695 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.687845 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.687994 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.688151 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.688298 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.688453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.689124 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.689285 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.689425 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.689563 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.689759 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.689903 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.690126 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.690282 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.690669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.690821 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.690959 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.691108 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.691268 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.691406 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.691556 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.691699 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.691848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.692017 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.692256 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.692365 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.692464 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.692557 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.692706 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.692808 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.693018 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.693125 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.693323 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.693425 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.693628 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.693723 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.693933 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.694029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.694236 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.694337 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.694546 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.694658 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.694848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.694950 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.695155 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.695256 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.695459 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.695563 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.695765 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.695868 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.696072 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.696195 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.696398 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.696502 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.696723 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.696818 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.697034 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.697129 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.697335 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.697436 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.697639 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.697739 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.697940 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.698033 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.698256 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.698364 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.698579 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.698681 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.698891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.698985 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.699197 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.699295 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.699532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.699632 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.699846 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.699939 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.700185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.700453 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.700566 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.700790 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.700897 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.701096 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.701213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.701416 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.701535 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.701728 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.701838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.702036 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.702139 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.702339 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.702430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.702640 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.702741 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.702962 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.703056 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.703268 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.703368 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.703577 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.703676 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.703883 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.703983 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.704745 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.704888 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.705064 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.705244 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.705372 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.705661 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.705754 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.705979 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.706095 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.706296 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.706390 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.706609 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.706701 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.706914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.707013 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.707222 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.707317 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.707529 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.707624 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.707835 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.707947 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.708181 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.708307 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.708497 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.708604 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.708802 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.708921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.709116 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.709222 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.709435 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.709536 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.709734 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.709857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.710040 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.710134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.710349 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.710470 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.710655 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.710760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.710958 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.711059 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.711269 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.711363 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.711575 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.711678 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.711884 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.711994 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.712210 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.712339 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.712631 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.712896 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.712991 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.713213 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.713306 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.713530 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.713633 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.713839 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.713932 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.714153 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.714253 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.714467 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.714569 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.714772 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.714865 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.715089 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.715189 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.715395 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.715494 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.715724 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.715843 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.716058 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.716184 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.716407 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.716503 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.716744 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.716847 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.717034 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.717128 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.717337 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.717432 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.717637 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.717729 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.717944 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.718037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.718260 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.718354 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.718565 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.718659 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.718867 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.719023 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.719165 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.719310 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.719470 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.719587 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.719789 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.719928 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.720285 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.720418 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.720609 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.720739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.720916 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.721038 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.721268 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.721383 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.721571 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.721676 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.721874 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.722076 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.722175 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.722270 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.722519 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.722630 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.722759 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.722870 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.723062 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.723158 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.723366 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.723460 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.723666 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.723762 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.723968 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.724062 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.724295 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.724392 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.724597 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.724706 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.724895 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.724997 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.725224 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.725320 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.725553 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.725650 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.725867 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.725974 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.726187 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.726290 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.726498 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.726593 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.726819 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.726919 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.727126 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.727228 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.727445 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.727539 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.727765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.727859 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.728075 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.728216 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.728411 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.728513 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.728739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.728844 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.729047 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.729149 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.729350 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.729450 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.729656 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.729749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.729963 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.730070 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.730279 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.730414 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.730574 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.730681 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.730885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.730990 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.731191 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.731355 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.731497 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.731599 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.731803 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.731898 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.732133 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.732231 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.732442 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.732565 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.732755 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.732857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.733063 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.733166 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.733385 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.733492 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.733691 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.733791 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.733998 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.734101 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.734302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.734406 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.734611 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.734706 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.734913 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.735006 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.735217 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.735320 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.735570 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.735676 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.735924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.736101 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.736240 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.736407 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.736565 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.736719 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.736942 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.737054 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.737225 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.737361 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.737545 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.737670 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.737882 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.738021 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.738213 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.738341 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.738533 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.738635 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.738846 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.738953 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.739165 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.739270 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.739492 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.739587 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.739800 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.739904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.740131 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.740250 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.740438 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.740585 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.740723 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 30 00:47:28.740835 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.741038 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.741341 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.742185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.742185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.749701 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.750528 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.750900 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.751786 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.752208 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.752568 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.752897 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.753221 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.753541 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.753904 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.754226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.754572 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.754897 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.755233 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.755559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.755892 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.756243 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.756573 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.756896 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.757221 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.757544 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.757863 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.758185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.758511 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.758834 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.759396 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.759731 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.760051 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.760392 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.760712 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.761027 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.761342 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.761657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.761968 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.762281 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.762593 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.762925 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.763250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.763579 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.763922 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.764264 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.764583 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.764902 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.765218 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.765581 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.765905 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.766218 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.766536 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.767490 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.767812 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.768153 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.768475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.768789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.769105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.769420 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.769735 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.770052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.770371 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.770699 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.771041 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.771365 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.771696 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.771997 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.772345 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.772873 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.773188 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.773524 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.773854 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.774183 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.774507 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.774829 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.775163 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.775478 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.775794 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.776125 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.776445 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.776755 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.777079 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.777392 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.777699 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.778020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.778329 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.778869 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.779226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.779549 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.779879 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.780244 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.780569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.780879 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.781213 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.781524 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.781835 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.782157 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.782544 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.782826 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.783136 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.783451 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.783766 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.784073 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.784408 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.784713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.785041 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.785350 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.785659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.785971 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.786286 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.786593 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.786901 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.787206 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.787513 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.787828 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.788223 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.789124 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.789124 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.789124 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.789492 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.789802 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.790111 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.790439 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.790748 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.791052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.791372 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.791681 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.792007 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.792348 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.792662 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.793014 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.793334 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.793870 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.794206 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.794531 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.794868 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.795202 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.795511 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.795827 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.796159 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.796487 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.796802 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.797117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.797430 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.797748 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.798087 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.798400 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.798710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.799021 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.799333 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.799644 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.799955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.800293 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.800604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.800916 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.801233 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.801580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.801898 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.802218 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.802536 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.802853 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.803165 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.803478 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.803618 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO dbcounter [None req-bfa81193-c04c-4121-927c-09d977c182f4 None None] Registered counter for database nova_api Oct 30 00:47:28.803788 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.804112 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.804434 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.804765 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.805078 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.805382 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.805817 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.806131 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.806452 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.806776 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.807085 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.807407 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.807730 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.808042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.808385 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.808696 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.809029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.809370 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.809699 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.810026 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.810334 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.810640 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.810946 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.811255 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.811579 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.811890 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.812219 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.812527 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.812836 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.813141 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.813448 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.814297 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.814603 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.814913 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.815218 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.815800 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.816103 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.816420 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.816723 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.817031 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.817339 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.817641 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.817945 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.818248 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.818552 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.818857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.819313 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.819663 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.819984 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.820656 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.820784 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.821060 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.821361 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.821686 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.822018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.822335 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.822650 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.822983 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.823297 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.823620 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.823922 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.824259 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.824681 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.824880 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.825213 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.825330 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_db.sqlalchemy.engines [None req-bfa81193-c04c-4121-927c-09d977c182f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 00:47:28.825544 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.825850 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.826179 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.826503 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.826824 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.827131 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.827437 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.827764 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.828076 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.828412 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.828724 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.829037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.829488 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.829811 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.830237 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.830560 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.830882 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.831203 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.831532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.831863 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.832203 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.832493 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writer thread running {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 00:47:28.832615 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.832852 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.833205 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.833523 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.833871 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.834203 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.834520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.834833 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.835138 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 30 00:47:28.835382 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 30 00:47:28.889060 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.context [None req-bfa81193-c04c-4121-927c-09d977c182f4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ea66ce74-ff55-4058-9ca3-10a503c16d39(cell1) {{(pid=125553) load_cells /opt/stack/nova/nova/context.py:464}} Oct 30 00:47:28.893299 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bfa81193-c04c-4121-927c-09d977c182f4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:47:28.893772 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bfa81193-c04c-4121-927c-09d977c182f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:47:28.895354 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bfa81193-c04c-4121-927c-09d977c182f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:47:28.896070 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bfa81193-c04c-4121-927c-09d977c182f4 None None] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:47:28.896530 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bfa81193-c04c-4121-927c-09d977c182f4 None None] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:47:28.898537 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bfa81193-c04c-4121-927c-09d977c182f4 None None] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:47:28.899185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO dbcounter [None req-7573c977-5d20-46bb-bde4-4b2762d701c3 None None] Registered counter for database nova_api Oct 30 00:47:28.900577 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO dbcounter [None req-bfa81193-c04c-4121-927c-09d977c182f4 None None] Registered counter for database nova_cell0 Oct 30 00:47:28.904707 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO dbcounter [None req-bfa81193-c04c-4121-927c-09d977c182f4 None None] Registered counter for database nova_cell1 Oct 30 00:47:28.913782 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_db.sqlalchemy.engines [None req-bfa81193-c04c-4121-927c-09d977c182f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 00:47:28.915127 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_db.sqlalchemy.engines [None req-bfa81193-c04c-4121-927c-09d977c182f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 00:47:28.920445 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_db.sqlalchemy.engines [None req-7573c977-5d20-46bb-bde4-4b2762d701c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125554) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 00:47:28.921817 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writer thread running {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 00:47:28.923683 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writer thread running {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 00:47:28.927730 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writer thread running {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 00:47:28.984657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.context [None req-7573c977-5d20-46bb-bde4-4b2762d701c3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ea66ce74-ff55-4058-9ca3-10a503c16d39(cell1) {{(pid=125554) load_cells /opt/stack/nova/nova/context.py:464}} Oct 30 00:47:28.989531 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7573c977-5d20-46bb-bde4-4b2762d701c3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:47:28.989947 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7573c977-5d20-46bb-bde4-4b2762d701c3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:47:28.991535 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7573c977-5d20-46bb-bde4-4b2762d701c3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:47:28.992283 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7573c977-5d20-46bb-bde4-4b2762d701c3 None None] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:47:28.992728 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7573c977-5d20-46bb-bde4-4b2762d701c3 None None] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:47:28.994744 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7573c977-5d20-46bb-bde4-4b2762d701c3 None None] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:47:28.996779 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO dbcounter [None req-7573c977-5d20-46bb-bde4-4b2762d701c3 None None] Registered counter for database nova_cell0 Oct 30 00:47:29.000963 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO dbcounter [None req-7573c977-5d20-46bb-bde4-4b2762d701c3 None None] Registered counter for database nova_cell1 Oct 30 00:47:29.008483 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_db.sqlalchemy.engines [None req-7573c977-5d20-46bb-bde4-4b2762d701c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125554) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 00:47:29.010773 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_db.sqlalchemy.engines [None req-7573c977-5d20-46bb-bde4-4b2762d701c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125554) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 00:47:29.016407 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writer thread running {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 00:47:29.019226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writer thread running {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 00:47:29.071111 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO dbcounter [None req-bfa81193-c04c-4121-927c-09d977c182f4 None None] Registered counter for database nova_cell0 Oct 30 00:47:29.079926 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_db.sqlalchemy.engines [None req-bfa81193-c04c-4121-927c-09d977c182f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 00:47:29.084637 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writer thread running {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 00:47:29.173622 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO dbcounter [None req-7573c977-5d20-46bb-bde4-4b2762d701c3 None None] Registered counter for database nova_cell0 Oct 30 00:47:29.181959 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_db.sqlalchemy.engines [None req-7573c977-5d20-46bb-bde4-4b2762d701c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125554) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 30 00:47:29.186849 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writer thread running {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 30 00:47:29.405262 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: WARNING keystonemiddleware.auth_token [None req-bfa81193-c04c-4121-927c-09d977c182f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 00:47:29.413170 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: WARNING keystonemiddleware.auth_token [None req-bfa81193-c04c-4121-927c-09d977c182f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 00:47:29.517293 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: WARNING keystonemiddleware.auth_token [None req-7573c977-5d20-46bb-bde4-4b2762d701c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 00:47:29.524826 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: WARNING keystonemiddleware.auth_token [None req-7573c977-5d20-46bb-bde4-4b2762d701c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 00:47:29.756446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: WARNING keystonemiddleware.auth_token [None req-bfa81193-c04c-4121-927c-09d977c182f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 00:47:29.762786 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: WARNING keystonemiddleware.auth_token [None req-bfa81193-c04c-4121-927c-09d977c182f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 00:47:29.769494 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556a5e9279c0 pid: 125553 (default app) Oct 30 00:47:29.878308 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: WARNING keystonemiddleware.auth_token [None req-7573c977-5d20-46bb-bde4-4b2762d701c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 30 00:47:29.884494 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: WARNING keystonemiddleware.auth_token [None req-7573c977-5d20-46bb-bde4-4b2762d701c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 30 00:47:29.889859 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556a5e9279c0 pid: 125554 (default app) Oct 30 00:48:04.451767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=3 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:04.453761 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=3 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:04.454709 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=3 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:04.455488 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=3 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:05.400380 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c156cf6a-2dc9-47f7-9828-8c60820ed350 tempest-VolumesGetTestJSON-1255796762 tempest-VolumesGetTestJSON-1255796762-project] Action: 'create', calling method: .version_select at 0x7faf76b9e940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-101505945", "metadata": {"Type": "work"}}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:48:07.273237 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c156cf6a-2dc9-47f7-9828-8c60820ed350 tempest-VolumesGetTestJSON-1255796762 tempest-VolumesGetTestJSON-1255796762-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.831688 Oct 30 00:48:07.273946 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1156 bytes} [Sun Oct 30 00:48:04 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2834 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 30 00:48:08.027535 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-1c56572e-5cb2-4e48-98eb-551efab37ea5 tempest-VolumesGetTestJSON-1255796762 tempest-VolumesGetTestJSON-1255796762-project] Calling method '.version_select at 0x7faf76bcea60>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:08.083278 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=3 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:08.083278 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=3 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:08.083278 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=3 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:08.083278 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=3 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:09.422149 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-1c56572e-5cb2-4e48-98eb-551efab37ea5 tempest-VolumesGetTestJSON-1255796762 tempest-VolumesGetTestJSON-1255796762-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/1f3104a0-4118-4ed2-bf4f-254647b52dd3" status: 200 len: 353 microversion: 2.1 time: 2.135134 Oct 30 00:48:09.423986 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 1/2] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Oct 30 00:48:07 2022] GET /compute/v2.1/os-volumes/1f3104a0-4118-4ed2-bf4f-254647b52dd3 => generated 353 bytes in 2139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:48:09.438701 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e8729b4c-beb5-4024-9199-d71cd1ae90d6 tempest-VolumesGetTestJSON-1255796762 tempest-VolumesGetTestJSON-1255796762-project] Calling method '.version_select at 0x7faf769e3e50>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:09.536362 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e8729b4c-beb5-4024-9199-d71cd1ae90d6 tempest-VolumesGetTestJSON-1255796762 tempest-VolumesGetTestJSON-1255796762-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/1f3104a0-4118-4ed2-bf4f-254647b52dd3" status: 200 len: 353 microversion: 2.1 time: 0.102322 Oct 30 00:48:09.537252 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Oct 30 00:48:09 2022] GET /compute/v2.1/os-volumes/1f3104a0-4118-4ed2-bf4f-254647b52dd3 => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:48:09.563993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-e0bbbf06-92c0-45cd-95c3-c7cf1341c728 tempest-VolumesGetTestJSON-1255796762 tempest-VolumesGetTestJSON-1255796762-project] Calling method '.version_select at 0x7faf76a21dc0>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:09.723478 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-e0bbbf06-92c0-45cd-95c3-c7cf1341c728 tempest-VolumesGetTestJSON-1255796762 tempest-VolumesGetTestJSON-1255796762-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/1f3104a0-4118-4ed2-bf4f-254647b52dd3" status: 202 len: 0 microversion: 2.1 time: 0.168242 Oct 30 00:48:09.724244 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1248 bytes} [Sun Oct 30 00:48:09 2022] DELETE /compute/v2.1/os-volumes/1f3104a0-4118-4ed2-bf4f-254647b52dd3 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 00:48:09.738222 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d05e7b73-ef7c-4488-b48e-74e4d5fa1885 tempest-VolumesGetTestJSON-1255796762 tempest-VolumesGetTestJSON-1255796762-project] Calling method '.version_select at 0x7faf76983550>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:09.868384 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d05e7b73-ef7c-4488-b48e-74e4d5fa1885 tempest-VolumesGetTestJSON-1255796762 tempest-VolumesGetTestJSON-1255796762-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/1f3104a0-4118-4ed2-bf4f-254647b52dd3" status: 200 len: 352 microversion: 2.1 time: 0.137380 Oct 30 00:48:09.877632 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 3/5] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Oct 30 00:48:09 2022] GET /compute/v2.1/os-volumes/1f3104a0-4118-4ed2-bf4f-254647b52dd3 => generated 352 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:48:10.109767 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-8d461664-f430-4e7d-87de-0a60f231cf44 tempest-VolumesTestJSON-1877022595 tempest-VolumesTestJSON-1877022595-project] Calling method '.version_select at 0x7faf76a21ca0>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:10.294629 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-8d461664-f430-4e7d-87de-0a60f231cf44 tempest-VolumesTestJSON-1877022595 tempest-VolumesTestJSON-1877022595-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b02e1cf7-234e-446b-97ad-b85b36d4e4f7" status: 200 len: 350 microversion: 2.1 time: 0.192223 Oct 30 00:48:10.295809 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 3/6] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Oct 30 00:48:10 2022] GET /compute/v2.1/os-volumes/b02e1cf7-234e-446b-97ad-b85b36d4e4f7 => generated 350 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 00:48:10.890762 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3fbdeb51-ef2f-4e76-8824-b10f19392f69 tempest-VolumesGetTestJSON-1255796762 tempest-VolumesGetTestJSON-1255796762-project] Calling method '.version_select at 0x7faf76983c10>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:10.943994 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-3fbdeb51-ef2f-4e76-8824-b10f19392f69 tempest-VolumesGetTestJSON-1255796762 tempest-VolumesGetTestJSON-1255796762-project] HTTP exception thrown: Volume 1f3104a0-4118-4ed2-bf4f-254647b52dd3 could not be found. Oct 30 00:48:10.949669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3fbdeb51-ef2f-4e76-8824-b10f19392f69 tempest-VolumesGetTestJSON-1255796762 tempest-VolumesGetTestJSON-1255796762-project] Request method failure captured: Oct 30 00:48:10.949669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: GET /compute/v2.1/os-volumes/1f3104a0-4118-4ed2-bf4f-254647b52dd3 HTTP/1.1 Oct 30 00:48:10.949669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 00:48:10.949669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 00:48:10.949669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 00:48:10.949669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 00:48:10.949669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 00:48:10.949669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 00:48:10.949669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 00:48:10.949669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 00:48:10.949669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXcnE0KlWtLPU3fdwePH3Nu8F_FQK0o--K8KH-5oPNn2tNHwRsLpJv9dymsrwmvfeNK7LficBYoyhYZ1z0EYA0GWqz_fXch5EhOiXH6q-na_6rE9a3Xtqa2d6JE1avqv5yQ7H8IKjQB6r3BvoupCrzOKolF5fkfaJCo04-KRcRZcE-Sg Oct 30 00:48:10.949669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 00:48:10.949669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 00:48:10.949669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 00:48:10.949669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 00:48:10.949669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 00:48:10.949669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 00:48:10.949669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: 7d10f71e30d04db39566e439f4fba6a1 Oct 30 00:48:10.949669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-VolumesGetTestJSON-1255796762 Oct 30 00:48:10.949669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 00:48:10.949669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 00:48:10.951094 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7d10f71e30d04db39566e439f4fba6a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7d10f71e30d04db39566e439f4fba6a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7d10f71e30d04db39566e439f4fba6a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7d10f71e30d04db39566e439f4fba6a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:48:10.951094 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-VolumesGetTestJSON-1255796762 Oct 30 00:48:10.951094 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: 7d10f71e30d04db39566e439f4fba6a1 Oct 30 00:48:10.951094 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-VolumesGetTestJSON-1255796762 Oct 30 00:48:10.951094 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-VolumesGetTestJSON-1255796762-project Oct 30 00:48:10.951094 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 00:48:10.951094 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 00:48:10.951094 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: 220cbd96393049598539054b1d2a180e Oct 30 00:48:10.951094 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-VolumesGetTestJSON-1255796762-project Oct 30 00:48:10.951094 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: Oct 30 00:48:10.951094 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Volume 1f3104a0-4118-4ed2-bf4f-254647b52dd3 could not be found. Oct 30 00:48:10.951094 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': '1f3104a0-4118-4ed2-bf4f-254647b52dd3'} Oct 30 00:48:10.951094 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:48:10.952215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:48:10.952215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 00:48:10.952215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 00:48:10.952215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 00:48:10.952215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 00:48:10.952215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 00:48:10.952215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 00:48:10.952215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 00:48:10.952215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 00:48:10.952215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 00:48:10.952215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 00:48:10.952215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 00:48:10.952215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 00:48:10.952215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 00:48:10.952215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 00:48:10.952215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f3104a0-4118-4ed2-bf4f-254647b52dd3 could not be found. (HTTP 404) (Request-ID: req-19bd1498-f7da-43cb-a9c8-127b044a2b0b) Oct 30 00:48:10.952215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:48:10.952215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:48:10.952215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:48:10.953544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:48:10.953544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 30 00:48:10.953544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 30 00:48:10.953544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 00:48:10.953544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 00:48:10.953544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 00:48:10.953544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 00:48:10.953544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 00:48:10.953544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 00:48:10.953544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 00:48:10.953544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 00:48:10.953544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 00:48:10.953544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 00:48:10.953544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 00:48:10.953544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 00:48:10.953544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 00:48:10.953544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 00:48:10.953544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 00:48:10.953544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 00:48:10.954879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 00:48:10.954879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 00:48:10.954879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 00:48:10.954879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 00:48:10.954879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f3104a0-4118-4ed2-bf4f-254647b52dd3 could not be found. Oct 30 00:48:10.954879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:48:10.954879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:48:10.954879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:48:10.954879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:48:10.954879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:48:10.954879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:48:10.954879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:48:10.954879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:48:10.954879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 00:48:10.954879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 00:48:10.954879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:48:10.954879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:48:10.954879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 30 00:48:10.954879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:48:10.956704 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f3104a0-4118-4ed2-bf4f-254647b52dd3 could not be found. Oct 30 00:48:10.956704 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:48:10.956704 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:48:10.956704 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:48:10.956704 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:48:10.956704 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:48:10.956704 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:48:10.956704 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:48:10.956704 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:48:10.956704 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f3104a0-4118-4ed2-bf4f-254647b52dd3 could not be found. Oct 30 00:48:10.956704 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:48:10.956704 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3fbdeb51-ef2f-4e76-8824-b10f19392f69 tempest-VolumesGetTestJSON-1255796762 tempest-VolumesGetTestJSON-1255796762-project] Returning 404 to user: Volume 1f3104a0-4118-4ed2-bf4f-254647b52dd3 could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:48:10.963128 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-3fbdeb51-ef2f-4e76-8824-b10f19392f69 tempest-VolumesGetTestJSON-1255796762 tempest-VolumesGetTestJSON-1255796762-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/1f3104a0-4118-4ed2-bf4f-254647b52dd3" status: 404 len: 109 microversion: 2.1 time: 0.070204 Oct 30 00:48:10.970918 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Oct 30 00:48:10 2022] GET /compute/v2.1/os-volumes/1f3104a0-4118-4ed2-bf4f-254647b52dd3 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 00:48:12.134417 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b1d74abb-7fdf-4e99-b5dd-31d7e34b6ee3 tempest-VolumesTestJSON-1877022595 tempest-VolumesTestJSON-1877022595-project] Calling method '.version_select at 0x7faf769e75e0>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:12.244163 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b1d74abb-7fdf-4e99-b5dd-31d7e34b6ee3 tempest-VolumesTestJSON-1877022595 tempest-VolumesTestJSON-1877022595-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/209f7f04-f6ed-48ac-af0d-da89ce2c6b15" status: 200 len: 351 microversion: 2.1 time: 0.117751 Oct 30 00:48:12.244752 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Oct 30 00:48:12 2022] GET /compute/v2.1/os-volumes/209f7f04-f6ed-48ac-af0d-da89ce2c6b15 => generated 351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:48:13.993513 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-edc263b3-71c6-471a-8629-399f55963a94 tempest-VolumesTestJSON-1877022595 tempest-VolumesTestJSON-1877022595-project] Calling method '.version_select at 0x7faf7696b5e0>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:14.134486 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-edc263b3-71c6-471a-8629-399f55963a94 tempest-VolumesTestJSON-1877022595 tempest-VolumesTestJSON-1877022595-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/007a25f5-71b2-4ea6-a904-ed41bde2dcb4" status: 200 len: 350 microversion: 2.1 time: 0.144656 Oct 30 00:48:14.135846 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 5/9] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Oct 30 00:48:13 2022] GET /compute/v2.1/os-volumes/007a25f5-71b2-4ea6-a904-ed41bde2dcb4 => generated 350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:48:14.155167 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-43237571-43b8-45a7-a415-d00a18e789b0 tempest-VolumesTestJSON-1877022595 tempest-VolumesTestJSON-1877022595-project] Calling method '.version_select at 0x7faf769e7b80>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:14.331327 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-43237571-43b8-45a7-a415-d00a18e789b0 tempest-VolumesTestJSON-1877022595 tempest-VolumesTestJSON-1877022595-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.180666 Oct 30 00:48:14.333097 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 5/10] 10.222.0.36 () {58 vars in 1134 bytes} [Sun Oct 30 00:48:14 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:14.350907 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e4798e48-9f95-41ec-b0b7-afebeb76ab46 tempest-VolumesTestJSON-1877022595 tempest-VolumesTestJSON-1877022595-project] Calling method '.version_select at 0x7faf7696bca0>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:14.587037 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e4798e48-9f95-41ec-b0b7-afebeb76ab46 tempest-VolumesTestJSON-1877022595 tempest-VolumesTestJSON-1877022595-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.240172 Oct 30 00:48:14.588835 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 6/11] 10.222.0.36 () {58 vars in 1149 bytes} [Sun Oct 30 00:48:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:48:14.621891 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-0d0345b5-afae-4cd5-b27d-953276364462 tempest-VolumesTestJSON-1877022595 tempest-VolumesTestJSON-1877022595-project] Calling method '.version_select at 0x7faf769e7a60>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:14.961666 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-0d0345b5-afae-4cd5-b27d-953276364462 tempest-VolumesTestJSON-1877022595 tempest-VolumesTestJSON-1877022595-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.355572 Oct 30 00:48:14.962335 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1134 bytes} [Sun Oct 30 00:48:14 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:14.981279 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a07878d9-bd22-417b-8523-1ff857084b90 tempest-VolumesTestJSON-1877022595 tempest-VolumesTestJSON-1877022595-project] Calling method '.version_select at 0x7faf7696b790>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:15.222705 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a07878d9-bd22-417b-8523-1ff857084b90 tempest-VolumesTestJSON-1877022595 tempest-VolumesTestJSON-1877022595-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.247591 Oct 30 00:48:15.223350 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1167 bytes} [Sun Oct 30 00:48:14 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:48:15.242931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-392be989-845a-4f25-8edc-41cc1d6a575a tempest-VolumesTestJSON-1877022595 tempest-VolumesTestJSON-1877022595-project] Calling method '.version_select at 0x7faf76984160>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:15.431584 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-392be989-845a-4f25-8edc-41cc1d6a575a tempest-VolumesTestJSON-1877022595 tempest-VolumesTestJSON-1877022595-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.191914 Oct 30 00:48:15.432215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 7/14] 10.222.0.36 () {58 vars in 1170 bytes} [Sun Oct 30 00:48:15 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:48:15.449840 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-dcc2288d-607c-418b-8e16-21c378ee0782 tempest-VolumesTestJSON-1877022595 tempest-VolumesTestJSON-1877022595-project] Calling method '.version_select at 0x7faf769711f0>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:15.639749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-dcc2288d-607c-418b-8e16-21c378ee0782 tempest-VolumesTestJSON-1877022595 tempest-VolumesTestJSON-1877022595-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.193485 Oct 30 00:48:15.641721 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 8/15] 10.222.0.36 () {58 vars in 1155 bytes} [Sun Oct 30 00:48:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:15.659174 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-bb7ddede-2479-4c9d-be63-9120c1613490 tempest-VolumesTestJSON-1877022595 tempest-VolumesTestJSON-1877022595-project] Calling method '.version_select at 0x7faf768f8550>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:15.940682 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-bb7ddede-2479-4c9d-be63-9120c1613490 tempest-VolumesTestJSON-1877022595 tempest-VolumesTestJSON-1877022595-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.285948 Oct 30 00:48:15.941443 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 9/16] 10.222.0.36 () {58 vars in 1188 bytes} [Sun Oct 30 00:48:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 00:48:15.959597 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-919dfcfe-3c82-44d2-8d83-c6e117eb9d3e tempest-VolumesTestJSON-1877022595 tempest-VolumesTestJSON-1877022595-project] Calling method '.version_select at 0x7faf769710d0>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:16.232585 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f72bf2af-46eb-46db-bbfc-eaf812d0307f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Action: 'create', calling method: .version_select at 0x7faf769e7670>, body: {"keypair": {"name": "tempest-keypair-2004726731", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyQ1kY3WbCKshCu3BhWz1Xx6WsbpCNIMXv+z3jsUPdJWe8C93K/D5y26y+rmB3+TUuRHR/0PU/0BdZzHhyOrOKrdnd95f9StaAWgWamNRkrTiLcK4KGJb1JDO92MlGDig=="}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:48:16.254129 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-919dfcfe-3c82-44d2-8d83-c6e117eb9d3e tempest-VolumesTestJSON-1877022595 tempest-VolumesTestJSON-1877022595-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.300669 Oct 30 00:48:16.254763 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 10/17] 10.222.0.36 () {58 vars in 1155 bytes} [Sun Oct 30 00:48:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:16.388904 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-f72bf2af-46eb-46db-bbfc-eaf812d0307f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Getting quotas for project 0f3b2aeb0e094f539e4affd66ea66272. Resources: {'key_pairs'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 00:48:16.407738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-f72bf2af-46eb-46db-bbfc-eaf812d0307f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Getting quotas for user df1ee15eb3bc468188a9d8c1af46529c and project 0f3b2aeb0e094f539e4affd66ea66272. Resources: {'key_pairs'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 00:48:16.511978 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-f72bf2af-46eb-46db-bbfc-eaf812d0307f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.021617 Oct 30 00:48:16.512636 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 8/18] 10.222.0.36 () {62 vars in 1200 bytes} [Sun Oct 30 00:48:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1023 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 30 00:48:19.499581 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1c4c3b75-0631-4c9b-a41a-7708ec015c76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1382569735", "imageRef": "27983dee-4bd6-4aad-9c28-22bd5382709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "adf2f392-f264-4582-889e-f327b7a40c30"}], "security_groups": [{"name": "tempest-securitygroup--440792118"}], "key_name": "tempest-keypair-2004726731", "user_data": "}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:48:20.003348 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.network.neutron [None req-1c4c3b75-0631-4c9b-a41a-7708ec015c76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] validate_networks() for [('adf2f392-f264-4582-889e-f327b7a40c30', None, None, None, None, None)] {{(pid=125553) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 00:48:22.863087 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-1c4c3b75-0631-4c9b-a41a-7708ec015c76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Flavor limits 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 00:48:22.863937 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-1c4c3b75-0631-4c9b-a41a-7708ec015c76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Image limits 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 00:48:22.864722 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-1c4c3b75-0631-4c9b-a41a-7708ec015c76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Flavor pref 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 00:48:22.866911 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-1c4c3b75-0631-4c9b-a41a-7708ec015c76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Image pref 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 00:48:22.867567 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-1c4c3b75-0631-4c9b-a41a-7708ec015c76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 00:48:22.950935 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1c4c3b75-0631-4c9b-a41a-7708ec015c76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:22.962026 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1c4c3b75-0631-4c9b-a41a-7708ec015c76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:22.962854 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1c4c3b75-0631-4c9b-a41a-7708ec015c76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:22.964565 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1c4c3b75-0631-4c9b-a41a-7708ec015c76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:22.968263 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1c4c3b75-0631-4c9b-a41a-7708ec015c76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:22.969623 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1c4c3b75-0631-4c9b-a41a-7708ec015c76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:23.146640 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-1c4c3b75-0631-4c9b-a41a-7708ec015c76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Getting quotas for project 0f3b2aeb0e094f539e4affd66ea66272. Resources: {'instances', 'cores', 'ram'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 00:48:23.174453 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-1c4c3b75-0631-4c9b-a41a-7708ec015c76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Getting quotas for user df1ee15eb3bc468188a9d8c1af46529c and project 0f3b2aeb0e094f539e4affd66ea66272. Resources: {'instances', 'cores', 'ram'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 00:48:23.207342 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1c4c3b75-0631-4c9b-a41a-7708ec015c76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Going to run 1 instances... {{(pid=125553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 00:48:23.216337 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1c4c3b75-0631-4c9b-a41a-7708ec015c76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27983dee-4bd6-4aad-9c28-22bd5382709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 00:48:23.413328 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1c4c3b75-0631-4c9b-a41a-7708ec015c76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.917465 Oct 30 00:48:23.415907 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 11/19] 10.222.0.36 () {62 vars in 1188 bytes} [Sun Oct 30 00:48:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 3922 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 30 00:48:23.429304 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c8ea15ab-b850-4c2e-a6bc-99494064d57c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:23.430075 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c8ea15ab-b850-4c2e-a6bc-99494064d57c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:23.703857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c8ea15ab-b850-4c2e-a6bc-99494064d57c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:23.746696 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c8ea15ab-b850-4c2e-a6bc-99494064d57c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:23.751403 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c8ea15ab-b850-4c2e-a6bc-99494064d57c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:23.760610 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c8ea15ab-b850-4c2e-a6bc-99494064d57c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1282 microversion: 2.20 time: 0.334869 Oct 30 00:48:23.764049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 9/20] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:23 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1282 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:48:24.791777 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-0c39983b-e7b1-42de-bd52-60983dd56a65 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:24.792517 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-0c39983b-e7b1-42de-bd52-60983dd56a65 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:25.333847 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-0c39983b-e7b1-42de-bd52-60983dd56a65 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:25.377747 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-0c39983b-e7b1-42de-bd52-60983dd56a65 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:25.382435 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-0c39983b-e7b1-42de-bd52-60983dd56a65 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:25.399238 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-0c39983b-e7b1-42de-bd52-60983dd56a65 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1282 microversion: 2.20 time: 0.611801 Oct 30 00:48:25.399843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 12/21] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:24 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1282 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:48:26.432927 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-1c09ad72-6e77-4eec-847d-dfc236cfb164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:26.434188 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-1c09ad72-6e77-4eec-847d-dfc236cfb164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:26.446435 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1c09ad72-6e77-4eec-847d-dfc236cfb164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:26.451854 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1c09ad72-6e77-4eec-847d-dfc236cfb164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:26.452585 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1c09ad72-6e77-4eec-847d-dfc236cfb164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:26.455132 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1c09ad72-6e77-4eec-847d-dfc236cfb164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:26.455791 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1c09ad72-6e77-4eec-847d-dfc236cfb164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:26.459918 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1c09ad72-6e77-4eec-847d-dfc236cfb164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:27.053811 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-1c09ad72-6e77-4eec-847d-dfc236cfb164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:27.090369 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-1c09ad72-6e77-4eec-847d-dfc236cfb164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:27.098435 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-1c09ad72-6e77-4eec-847d-dfc236cfb164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:27.107825 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-1c09ad72-6e77-4eec-847d-dfc236cfb164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1286 microversion: 2.20 time: 0.677030 Oct 30 00:48:27.109967 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 10/22] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:26 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1286 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:48:28.083015 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a2c82e01-09cf-42e5-876b-4d4a001e255f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1710741394", "imageRef": "27983dee-4bd6-4aad-9c28-22bd5382709a", "flavorRef": "452", "networks": [{"uuid": "ae8fdd4a-f7ca-4727-a5d3-5109d3895c0a"}]}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:48:28.140726 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ca534627-1fd8-4497-b555-493554a43333 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:28.141947 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ca534627-1fd8-4497-b555-493554a43333 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:28.155175 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca534627-1fd8-4497-b555-493554a43333 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:28.161544 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca534627-1fd8-4497-b555-493554a43333 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:28.161991 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca534627-1fd8-4497-b555-493554a43333 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:28.162712 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca534627-1fd8-4497-b555-493554a43333 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:28.163828 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca534627-1fd8-4497-b555-493554a43333 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:28.164431 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca534627-1fd8-4497-b555-493554a43333 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:28.212382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.network.neutron [None req-a2c82e01-09cf-42e5-876b-4d4a001e255f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] validate_networks() for [('ae8fdd4a-f7ca-4727-a5d3-5109d3895c0a', None, None, None, None, None)] {{(pid=125553) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 00:48:28.579030 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ca534627-1fd8-4497-b555-493554a43333 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:28.591527 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ca534627-1fd8-4497-b555-493554a43333 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:28.593771 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ca534627-1fd8-4497-b555-493554a43333 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:28.594894 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ca534627-1fd8-4497-b555-493554a43333 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1286 microversion: 2.20 time: 0.459186 Oct 30 00:48:28.597279 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 11/23] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:28 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1286 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:48:29.113142 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-a2c82e01-09cf-42e5-876b-4d4a001e255f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Flavor limits 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 00:48:29.113599 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-a2c82e01-09cf-42e5-876b-4d4a001e255f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Image limits 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 00:48:29.114017 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-a2c82e01-09cf-42e5-876b-4d4a001e255f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Flavor pref 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 00:48:29.114451 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-a2c82e01-09cf-42e5-876b-4d4a001e255f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Image pref 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 00:48:29.114861 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-a2c82e01-09cf-42e5-876b-4d4a001e255f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 00:48:29.134833 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a2c82e01-09cf-42e5-876b-4d4a001e255f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:29.136787 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a2c82e01-09cf-42e5-876b-4d4a001e255f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:29.137337 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a2c82e01-09cf-42e5-876b-4d4a001e255f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:29.137996 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a2c82e01-09cf-42e5-876b-4d4a001e255f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:29.138533 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a2c82e01-09cf-42e5-876b-4d4a001e255f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:29.140117 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a2c82e01-09cf-42e5-876b-4d4a001e255f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:29.180035 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-a2c82e01-09cf-42e5-876b-4d4a001e255f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Getting quotas for project e1b5b4b97dfd468f923996968764d206. Resources: {'instances', 'cores', 'ram'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 00:48:29.198043 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-a2c82e01-09cf-42e5-876b-4d4a001e255f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Getting quotas for user 8135391c507d4f06aeb7e74160bbd038 and project e1b5b4b97dfd468f923996968764d206. Resources: {'instances', 'cores', 'ram'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 00:48:29.229783 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a2c82e01-09cf-42e5-876b-4d4a001e255f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Going to run 1 instances... {{(pid=125553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 00:48:29.230142 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-014125dd-fbf6-48be-946c-58e8b6e285cf tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Action: 'create', calling method: .version_select at 0x7faf768595e0>, body: {"keypair": {"name": "tempest-keypair-139374969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0+sdrjN8rTuAWoF4BGyg+koeM0SeU1wPajBQZoM8RXqUuHrPq9DHV/5FEOe64J0gXguy/WNjZbGHvAHK6vTd9/xQiiWw1cajrb8Or/64sEPsl3ZKbBVpJsfVkz9Z8avA=="}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:48:29.234169 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a2c82e01-09cf-42e5-876b-4d4a001e255f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27983dee-4bd6-4aad-9c28-22bd5382709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 00:48:29.274486 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-014125dd-fbf6-48be-946c-58e8b6e285cf tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Getting quotas for project bb5d551adcf64bb8aea88a6c142cea5e. Resources: {'key_pairs'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 00:48:29.287630 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-014125dd-fbf6-48be-946c-58e8b6e285cf tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Getting quotas for user 5ac3fdb86ac24fa493706f84e1aa40a8 and project bb5d551adcf64bb8aea88a6c142cea5e. Resources: {'key_pairs'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 00:48:29.342596 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a2c82e01-09cf-42e5-876b-4d4a001e255f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.867021 Oct 30 00:48:29.346397 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 13/24] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Oct 30 00:48:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 00:48:29.358815 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-014125dd-fbf6-48be-946c-58e8b6e285cf tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.632533 Oct 30 00:48:29.363412 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 12/25] 10.222.0.36 () {60 vars in 1159 bytes} [Sun Oct 30 00:48:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:48:29.389404 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-dd5a65d3-6be2-40fc-91dc-f53f748111d9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:29.398156 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-dd5a65d3-6be2-40fc-91dc-f53f748111d9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:29.612858 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-dd5a65d3-6be2-40fc-91dc-f53f748111d9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:29.621244 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-dd5a65d3-6be2-40fc-91dc-f53f748111d9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1215 microversion: 2.1 time: 0.256723 Oct 30 00:48:29.621816 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 13/26] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:29 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1215 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:29.646415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-0a2044db-c302-4a8d-8665-dde49c836498 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:29.648822 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-0a2044db-c302-4a8d-8665-dde49c836498 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:29.671134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0a2044db-c302-4a8d-8665-dde49c836498 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:29.673640 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0a2044db-c302-4a8d-8665-dde49c836498 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:29.674310 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0a2044db-c302-4a8d-8665-dde49c836498 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:29.675215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0a2044db-c302-4a8d-8665-dde49c836498 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:29.675852 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0a2044db-c302-4a8d-8665-dde49c836498 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:29.677513 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0a2044db-c302-4a8d-8665-dde49c836498 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:30.067566 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1fa77dbb-57c4-4d24-b34c-7358558c9a6c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-120958003", "imageRef": "27983dee-4bd6-4aad-9c28-22bd5382709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:48:30.075641 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-0a2044db-c302-4a8d-8665-dde49c836498 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:30.096641 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-0a2044db-c302-4a8d-8665-dde49c836498 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:30.100223 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-0a2044db-c302-4a8d-8665-dde49c836498 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:30.104854 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-0a2044db-c302-4a8d-8665-dde49c836498 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1340 microversion: 2.20 time: 0.467240 Oct 30 00:48:30.123033 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 14/27] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:29 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1340 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:48:30.245118 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.network.neutron [None req-1fa77dbb-57c4-4d24-b34c-7358558c9a6c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] validate_networks() for [('a09af5e2-1845-4aed-bafe-f78c90792385', None, None, None, None, None)] {{(pid=125553) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 00:48:30.644991 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c2c6faa1-879c-4ddb-bb15-d1d7a0e9b31b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:30.645669 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c2c6faa1-879c-4ddb-bb15-d1d7a0e9b31b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:31.001486 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c2c6faa1-879c-4ddb-bb15-d1d7a0e9b31b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:31.016781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c2c6faa1-879c-4ddb-bb15-d1d7a0e9b31b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1215 microversion: 2.1 time: 0.375723 Oct 30 00:48:31.037159 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 15/28] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:30 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1215 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:48:31.139433 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-daeefa3c-0109-46a4-a0b1-fdd157bd8c5f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:31.140599 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-daeefa3c-0109-46a4-a0b1-fdd157bd8c5f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:31.158227 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-daeefa3c-0109-46a4-a0b1-fdd157bd8c5f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:31.182459 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-daeefa3c-0109-46a4-a0b1-fdd157bd8c5f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:31.186751 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-daeefa3c-0109-46a4-a0b1-fdd157bd8c5f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:31.195912 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-daeefa3c-0109-46a4-a0b1-fdd157bd8c5f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:31.196986 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-daeefa3c-0109-46a4-a0b1-fdd157bd8c5f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:31.197727 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-daeefa3c-0109-46a4-a0b1-fdd157bd8c5f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:31.760096 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-daeefa3c-0109-46a4-a0b1-fdd157bd8c5f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:31.796865 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-daeefa3c-0109-46a4-a0b1-fdd157bd8c5f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:31.801994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-daeefa3c-0109-46a4-a0b1-fdd157bd8c5f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:31.811924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-daeefa3c-0109-46a4-a0b1-fdd157bd8c5f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1340 microversion: 2.20 time: 0.677626 Oct 30 00:48:31.821694 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 16/29] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:31 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1340 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:48:32.051931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-da467f5a-4be0-4798-9d94-e3131337644d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:32.052942 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-da467f5a-4be0-4798-9d94-e3131337644d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:32.067836 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-da467f5a-4be0-4798-9d94-e3131337644d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:32.073732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-da467f5a-4be0-4798-9d94-e3131337644d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:32.074713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-da467f5a-4be0-4798-9d94-e3131337644d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:32.080195 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-da467f5a-4be0-4798-9d94-e3131337644d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:32.081263 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-da467f5a-4be0-4798-9d94-e3131337644d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:32.082372 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-da467f5a-4be0-4798-9d94-e3131337644d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:32.241734 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-1fa77dbb-57c4-4d24-b34c-7358558c9a6c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Flavor limits 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 00:48:32.243063 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-1fa77dbb-57c4-4d24-b34c-7358558c9a6c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Image limits 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 00:48:32.243773 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-1fa77dbb-57c4-4d24-b34c-7358558c9a6c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Flavor pref 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 00:48:32.244432 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-1fa77dbb-57c4-4d24-b34c-7358558c9a6c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Image pref 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 00:48:32.245220 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-1fa77dbb-57c4-4d24-b34c-7358558c9a6c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 00:48:32.262555 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1fa77dbb-57c4-4d24-b34c-7358558c9a6c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:32.263850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1fa77dbb-57c4-4d24-b34c-7358558c9a6c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:32.267633 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-da467f5a-4be0-4798-9d94-e3131337644d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:32.274785 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1fa77dbb-57c4-4d24-b34c-7358558c9a6c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:32.278749 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-da467f5a-4be0-4798-9d94-e3131337644d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1267 microversion: 2.1 time: 0.231212 Oct 30 00:48:32.300614 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1fa77dbb-57c4-4d24-b34c-7358558c9a6c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:32.302389 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 17/30] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:32 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1267 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:32.303437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1fa77dbb-57c4-4d24-b34c-7358558c9a6c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:32.306554 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1fa77dbb-57c4-4d24-b34c-7358558c9a6c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:32.405859 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-1fa77dbb-57c4-4d24-b34c-7358558c9a6c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Getting quotas for project 999d27163d544dff836ab7d90355f0d6. Resources: {'instances', 'cores', 'ram'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 00:48:32.423832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-1fa77dbb-57c4-4d24-b34c-7358558c9a6c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Getting quotas for user 350f5e4238f448949b2c372aabbfc835 and project 999d27163d544dff836ab7d90355f0d6. Resources: {'instances', 'cores', 'ram'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 00:48:32.467922 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1fa77dbb-57c4-4d24-b34c-7358558c9a6c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Going to run 1 instances... {{(pid=125553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 00:48:32.476494 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1fa77dbb-57c4-4d24-b34c-7358558c9a6c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27983dee-4bd6-4aad-9c28-22bd5382709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 00:48:32.606735 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1fa77dbb-57c4-4d24-b34c-7358558c9a6c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.253284 Oct 30 00:48:32.610212 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 14/31] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Oct 30 00:48:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 3261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 00:48:32.620950 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-1a82fce6-c13b-479a-840c-bba4feefcbb3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:32.622027 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-1a82fce6-c13b-479a-840c-bba4feefcbb3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:32.851309 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-7e66e08f-3984-4ac0-b37e-02dacb875ba8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:32.852309 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-7e66e08f-3984-4ac0-b37e-02dacb875ba8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:32.868621 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7e66e08f-3984-4ac0-b37e-02dacb875ba8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:32.873743 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7e66e08f-3984-4ac0-b37e-02dacb875ba8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:32.878962 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7e66e08f-3984-4ac0-b37e-02dacb875ba8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:32.886258 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7e66e08f-3984-4ac0-b37e-02dacb875ba8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:32.886783 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7e66e08f-3984-4ac0-b37e-02dacb875ba8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:32.887588 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7e66e08f-3984-4ac0-b37e-02dacb875ba8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:33.704483 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-1a82fce6-c13b-479a-840c-bba4feefcbb3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:33.715528 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-1a82fce6-c13b-479a-840c-bba4feefcbb3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1221 microversion: 2.1 time: 1.096332 Oct 30 00:48:33.731925 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 18/32] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:32 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1221 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:33.755498 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d8fc09d5-6ab2-4bd7-89e8-b3539e31976f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:33.756008 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-d8fc09d5-6ab2-4bd7-89e8-b3539e31976f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:33.795964 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d8fc09d5-6ab2-4bd7-89e8-b3539e31976f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:33.796573 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d8fc09d5-6ab2-4bd7-89e8-b3539e31976f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:33.801690 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d8fc09d5-6ab2-4bd7-89e8-b3539e31976f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:33.803066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-7e66e08f-3984-4ac0-b37e-02dacb875ba8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:33.806264 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d8fc09d5-6ab2-4bd7-89e8-b3539e31976f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:33.808273 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d8fc09d5-6ab2-4bd7-89e8-b3539e31976f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:33.808995 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d8fc09d5-6ab2-4bd7-89e8-b3539e31976f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:33.876907 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-7e66e08f-3984-4ac0-b37e-02dacb875ba8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:33.891870 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-7e66e08f-3984-4ac0-b37e-02dacb875ba8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:33.905723 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-7e66e08f-3984-4ac0-b37e-02dacb875ba8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1340 microversion: 2.20 time: 1.057383 Oct 30 00:48:33.910203 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 15/33] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:32 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1340 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:48:34.190460 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-47bb43a8-258e-451f-b270-16e9d48b160b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-815281388", "imageRef": "27983dee-4bd6-4aad-9c28-22bd5382709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:48:34.330327 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-d8fc09d5-6ab2-4bd7-89e8-b3539e31976f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:34.342488 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-d8fc09d5-6ab2-4bd7-89e8-b3539e31976f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1273 microversion: 2.1 time: 0.616101 Oct 30 00:48:34.358801 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 19/34] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:33 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1273 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:34.409581 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.network.neutron [None req-47bb43a8-258e-451f-b270-16e9d48b160b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] validate_networks() for [('a09af5e2-1845-4aed-bafe-f78c90792385', None, None, None, None, None)] {{(pid=125553) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 00:48:34.940568 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-3ded7b6e-ddfa-4189-850d-af6937c20983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:34.941807 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-3ded7b6e-ddfa-4189-850d-af6937c20983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:34.957151 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3ded7b6e-ddfa-4189-850d-af6937c20983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:34.960552 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3ded7b6e-ddfa-4189-850d-af6937c20983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:34.961254 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3ded7b6e-ddfa-4189-850d-af6937c20983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:34.962897 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3ded7b6e-ddfa-4189-850d-af6937c20983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:34.965123 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3ded7b6e-ddfa-4189-850d-af6937c20983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:34.969457 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3ded7b6e-ddfa-4189-850d-af6937c20983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:36.480133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-3ded7b6e-ddfa-4189-850d-af6937c20983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:36.496615 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-3ded7b6e-ddfa-4189-850d-af6937c20983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:36.531076 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-3ded7b6e-ddfa-4189-850d-af6937c20983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:36.537753 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-3ded7b6e-ddfa-4189-850d-af6937c20983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 1.602169 Oct 30 00:48:36.541886 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 20/35] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:34 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:48:36.557809 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-741d9e41-06ad-4a6c-b5ed-2c385c308bf7 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:36.586484 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-741d9e41-06ad-4a6c-b5ed-2c385c308bf7 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:36.623685 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-741d9e41-06ad-4a6c-b5ed-2c385c308bf7 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:36.627429 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-741d9e41-06ad-4a6c-b5ed-2c385c308bf7 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:36.628885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-741d9e41-06ad-4a6c-b5ed-2c385c308bf7 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:36.631398 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-741d9e41-06ad-4a6c-b5ed-2c385c308bf7 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:36.633369 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-741d9e41-06ad-4a6c-b5ed-2c385c308bf7 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:36.634109 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-741d9e41-06ad-4a6c-b5ed-2c385c308bf7 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:36.759190 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-47bb43a8-258e-451f-b270-16e9d48b160b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Flavor limits 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 00:48:36.760302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-47bb43a8-258e-451f-b270-16e9d48b160b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Image limits 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 00:48:36.760927 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-47bb43a8-258e-451f-b270-16e9d48b160b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Flavor pref 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 00:48:36.761485 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-47bb43a8-258e-451f-b270-16e9d48b160b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Image pref 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 00:48:36.762067 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-47bb43a8-258e-451f-b270-16e9d48b160b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 00:48:36.781661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-47bb43a8-258e-451f-b270-16e9d48b160b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:36.788717 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-47bb43a8-258e-451f-b270-16e9d48b160b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:36.790551 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-47bb43a8-258e-451f-b270-16e9d48b160b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:36.792609 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-47bb43a8-258e-451f-b270-16e9d48b160b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:36.805817 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-47bb43a8-258e-451f-b270-16e9d48b160b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:36.807794 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-47bb43a8-258e-451f-b270-16e9d48b160b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:36.908429 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-47bb43a8-258e-451f-b270-16e9d48b160b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Getting quotas for project 999d27163d544dff836ab7d90355f0d6. Resources: {'instances', 'cores', 'ram'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 00:48:36.914034 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-47bb43a8-258e-451f-b270-16e9d48b160b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Getting quotas for user 350f5e4238f448949b2c372aabbfc835 and project 999d27163d544dff836ab7d90355f0d6. Resources: {'instances', 'cores', 'ram'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 00:48:36.932433 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-47bb43a8-258e-451f-b270-16e9d48b160b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Going to run 1 instances... {{(pid=125553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 00:48:36.936808 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-47bb43a8-258e-451f-b270-16e9d48b160b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27983dee-4bd6-4aad-9c28-22bd5382709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 00:48:37.020668 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-741d9e41-06ad-4a6c-b5ed-2c385c308bf7 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:37.070325 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-47bb43a8-258e-451f-b270-16e9d48b160b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.888527 Oct 30 00:48:37.074069 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 16/36] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Oct 30 00:48:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 2893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 00:48:37.077721 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-741d9e41-06ad-4a6c-b5ed-2c385c308bf7 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1273 microversion: 2.1 time: 0.533804 Oct 30 00:48:37.096228 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 21/37] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:36 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1273 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:37.097158 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-565cc118-b243-45f9-ac2a-ee2fc8790090 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:37.097774 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-565cc118-b243-45f9-ac2a-ee2fc8790090 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:37.292494 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-565cc118-b243-45f9-ac2a-ee2fc8790090 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:37.305643 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-565cc118-b243-45f9-ac2a-ee2fc8790090 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1221 microversion: 2.1 time: 0.221415 Oct 30 00:48:37.306813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 17/38] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:37 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1221 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:37.550937 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-e30dfe3a-27fd-40c0-b1ce-b6f553c5599d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2094977090", "imageRef": "27983dee-4bd6-4aad-9c28-22bd5382709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "916e17cb-b08e-4b0c-b5e7-c44a5f632210"}], "security_groups": [{"name": "tempest-securitygroup--2064716798"}], "key_name": "tempest-keypair-139374969", "user_data": "}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:48:37.573115 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-34bc3ab0-04cd-4eca-9777-06e39512d177 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:37.574418 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-34bc3ab0-04cd-4eca-9777-06e39512d177 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:37.597268 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34bc3ab0-04cd-4eca-9777-06e39512d177 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:37.598763 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34bc3ab0-04cd-4eca-9777-06e39512d177 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:37.600755 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34bc3ab0-04cd-4eca-9777-06e39512d177 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:37.601632 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34bc3ab0-04cd-4eca-9777-06e39512d177 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:37.602123 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34bc3ab0-04cd-4eca-9777-06e39512d177 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:37.602634 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34bc3ab0-04cd-4eca-9777-06e39512d177 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:38.351702 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-34bc3ab0-04cd-4eca-9777-06e39512d177 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:38.366488 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-34bc3ab0-04cd-4eca-9777-06e39512d177 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:38.395406 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.network.neutron [None req-e30dfe3a-27fd-40c0-b1ce-b6f553c5599d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] validate_networks() for [('916e17cb-b08e-4b0c-b5e7-c44a5f632210', None, None, None, None, None)] {{(pid=125554) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 00:48:38.405451 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-34bc3ab0-04cd-4eca-9777-06e39512d177 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:38.420819 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-34bc3ab0-04cd-4eca-9777-06e39512d177 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.842552 Oct 30 00:48:38.434785 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 18/39] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:37 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:48:38.482135 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d3927294-518d-43e0-a4ce-78949997eb54 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:38.487354 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d3927294-518d-43e0-a4ce-78949997eb54 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:38.528259 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d3927294-518d-43e0-a4ce-78949997eb54 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:38.534477 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d3927294-518d-43e0-a4ce-78949997eb54 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:38.534961 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d3927294-518d-43e0-a4ce-78949997eb54 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:38.542226 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d3927294-518d-43e0-a4ce-78949997eb54 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:38.543698 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d3927294-518d-43e0-a4ce-78949997eb54 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:38.547066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d3927294-518d-43e0-a4ce-78949997eb54 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:39.152330 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=2 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:39.177509 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d3927294-518d-43e0-a4ce-78949997eb54 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:39.202752 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d3927294-518d-43e0-a4ce-78949997eb54 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.750518 Oct 30 00:48:39.204102 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 19/40] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:38 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:39.218657 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1af768d1-bcee-41ff-a578-2de83cbb42c8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:39.219484 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1af768d1-bcee-41ff-a578-2de83cbb42c8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:39.232831 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1af768d1-bcee-41ff-a578-2de83cbb42c8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:39.236376 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1af768d1-bcee-41ff-a578-2de83cbb42c8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:39.237880 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1af768d1-bcee-41ff-a578-2de83cbb42c8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:39.242463 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1af768d1-bcee-41ff-a578-2de83cbb42c8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:39.243234 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1af768d1-bcee-41ff-a578-2de83cbb42c8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:39.245100 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1af768d1-bcee-41ff-a578-2de83cbb42c8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:39.489738 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1af768d1-bcee-41ff-a578-2de83cbb42c8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:39.511273 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1af768d1-bcee-41ff-a578-2de83cbb42c8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1273 microversion: 2.1 time: 0.302832 Oct 30 00:48:39.518430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 20/41] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:39 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1273 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:39.540712 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c693f995-9e6a-46e3-b597-cde684292261 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:39.548964 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-c693f995-9e6a-46e3-b597-cde684292261 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:39.577309 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c693f995-9e6a-46e3-b597-cde684292261 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:39.581022 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c693f995-9e6a-46e3-b597-cde684292261 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:39.581570 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c693f995-9e6a-46e3-b597-cde684292261 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:39.582306 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c693f995-9e6a-46e3-b597-cde684292261 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:39.589672 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c693f995-9e6a-46e3-b597-cde684292261 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:39.590326 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c693f995-9e6a-46e3-b597-cde684292261 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:40.171910 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c693f995-9e6a-46e3-b597-cde684292261 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:40.190648 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c693f995-9e6a-46e3-b597-cde684292261 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:40.205868 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c693f995-9e6a-46e3-b597-cde684292261 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:40.210012 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c693f995-9e6a-46e3-b597-cde684292261 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.689718 Oct 30 00:48:40.220304 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 21/42] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:39 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:48:40.247265 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-287d4e55-2e71-432d-89ba-c2d31fe777f4 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:40.249378 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-287d4e55-2e71-432d-89ba-c2d31fe777f4 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:40.272766 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-287d4e55-2e71-432d-89ba-c2d31fe777f4 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:40.273552 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-287d4e55-2e71-432d-89ba-c2d31fe777f4 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:40.274242 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-287d4e55-2e71-432d-89ba-c2d31fe777f4 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:40.275811 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-287d4e55-2e71-432d-89ba-c2d31fe777f4 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:40.279641 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-287d4e55-2e71-432d-89ba-c2d31fe777f4 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:40.280518 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-287d4e55-2e71-432d-89ba-c2d31fe777f4 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:40.629326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-e30dfe3a-27fd-40c0-b1ce-b6f553c5599d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Flavor limits 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 00:48:40.629921 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-e30dfe3a-27fd-40c0-b1ce-b6f553c5599d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Image limits 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 00:48:40.630276 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-e30dfe3a-27fd-40c0-b1ce-b6f553c5599d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Flavor pref 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 00:48:40.630693 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-e30dfe3a-27fd-40c0-b1ce-b6f553c5599d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Image pref 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 00:48:40.631150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-e30dfe3a-27fd-40c0-b1ce-b6f553c5599d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 00:48:40.641341 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=17 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:40.666796 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e30dfe3a-27fd-40c0-b1ce-b6f553c5599d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:40.666898 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e30dfe3a-27fd-40c0-b1ce-b6f553c5599d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:40.675045 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e30dfe3a-27fd-40c0-b1ce-b6f553c5599d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:40.677287 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e30dfe3a-27fd-40c0-b1ce-b6f553c5599d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:40.683578 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e30dfe3a-27fd-40c0-b1ce-b6f553c5599d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:40.684323 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e30dfe3a-27fd-40c0-b1ce-b6f553c5599d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:40.759225 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-e30dfe3a-27fd-40c0-b1ce-b6f553c5599d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Getting quotas for project bb5d551adcf64bb8aea88a6c142cea5e. Resources: {'instances', 'cores', 'ram'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 00:48:40.774713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-e30dfe3a-27fd-40c0-b1ce-b6f553c5599d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Getting quotas for user 5ac3fdb86ac24fa493706f84e1aa40a8 and project bb5d551adcf64bb8aea88a6c142cea5e. Resources: {'instances', 'cores', 'ram'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 00:48:40.822908 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-e30dfe3a-27fd-40c0-b1ce-b6f553c5599d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Going to run 1 instances... {{(pid=125554) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 00:48:40.838481 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-e30dfe3a-27fd-40c0-b1ce-b6f553c5599d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27983dee-4bd6-4aad-9c28-22bd5382709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125554) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 00:48:40.940746 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-287d4e55-2e71-432d-89ba-c2d31fe777f4 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:40.956990 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-287d4e55-2e71-432d-89ba-c2d31fe777f4 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.717551 Oct 30 00:48:40.960678 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 22/43] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:40 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:40.979172 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c96b7b78-cdf3-47ec-8576-606269d0845d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:40.984900 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-c96b7b78-cdf3-47ec-8576-606269d0845d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:41.014805 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c96b7b78-cdf3-47ec-8576-606269d0845d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:41.019066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c96b7b78-cdf3-47ec-8576-606269d0845d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:41.025619 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c96b7b78-cdf3-47ec-8576-606269d0845d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:41.026595 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c96b7b78-cdf3-47ec-8576-606269d0845d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:41.028008 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c96b7b78-cdf3-47ec-8576-606269d0845d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:41.029506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c96b7b78-cdf3-47ec-8576-606269d0845d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:41.080201 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-e30dfe3a-27fd-40c0-b1ce-b6f553c5599d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.535559 Oct 30 00:48:41.081377 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 22/44] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Oct 30 00:48:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 3537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 00:48:41.111212 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-54b08e47-3878-4dbe-ad68-3b92bbecedfc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:41.117123 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-54b08e47-3878-4dbe-ad68-3b92bbecedfc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:41.370467 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-54b08e47-3878-4dbe-ad68-3b92bbecedfc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:41.384308 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-54b08e47-3878-4dbe-ad68-3b92bbecedfc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1237 microversion: 2.1 time: 0.293952 Oct 30 00:48:41.389559 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c96b7b78-cdf3-47ec-8576-606269d0845d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:41.401271 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 23/45] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:41 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1237 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:41.409083 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c96b7b78-cdf3-47ec-8576-606269d0845d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1279 microversion: 2.1 time: 0.446392 Oct 30 00:48:41.416029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-34839e59-15ff-4205-896e-21d1f26eaf94 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:41.416780 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-34839e59-15ff-4205-896e-21d1f26eaf94 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:41.423684 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 23/46] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:40 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1279 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:41.433146 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-34839e59-15ff-4205-896e-21d1f26eaf94 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:41.433641 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-34839e59-15ff-4205-896e-21d1f26eaf94 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:41.434082 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-34839e59-15ff-4205-896e-21d1f26eaf94 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:41.436816 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-34839e59-15ff-4205-896e-21d1f26eaf94 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:41.437496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-34839e59-15ff-4205-896e-21d1f26eaf94 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:41.438358 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-34839e59-15ff-4205-896e-21d1f26eaf94 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:41.993712 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d4de3d15-2d61-4b55-b78e-d3c6b389e8cb tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:41.995803 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d4de3d15-2d61-4b55-b78e-d3c6b389e8cb tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:42.023211 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d4de3d15-2d61-4b55-b78e-d3c6b389e8cb tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:42.026671 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d4de3d15-2d61-4b55-b78e-d3c6b389e8cb tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:42.027370 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d4de3d15-2d61-4b55-b78e-d3c6b389e8cb tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:42.030021 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d4de3d15-2d61-4b55-b78e-d3c6b389e8cb tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:42.034103 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d4de3d15-2d61-4b55-b78e-d3c6b389e8cb tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:42.034584 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d4de3d15-2d61-4b55-b78e-d3c6b389e8cb tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:42.260510 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-34839e59-15ff-4205-896e-21d1f26eaf94 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:42.297865 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-34839e59-15ff-4205-896e-21d1f26eaf94 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:42.300579 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-34839e59-15ff-4205-896e-21d1f26eaf94 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:42.302203 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-34839e59-15ff-4205-896e-21d1f26eaf94 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.895772 Oct 30 00:48:42.307152 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 24/47] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:41 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:48:42.415447 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-926d55ab-074c-4e1b-9ad4-79027b1934db tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:42.416304 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-926d55ab-074c-4e1b-9ad4-79027b1934db tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:42.427466 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-926d55ab-074c-4e1b-9ad4-79027b1934db tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:42.436180 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-926d55ab-074c-4e1b-9ad4-79027b1934db tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:42.437827 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-926d55ab-074c-4e1b-9ad4-79027b1934db tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:42.445712 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-926d55ab-074c-4e1b-9ad4-79027b1934db tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:42.447667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-926d55ab-074c-4e1b-9ad4-79027b1934db tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:42.448383 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-926d55ab-074c-4e1b-9ad4-79027b1934db tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:42.645360 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-926d55ab-074c-4e1b-9ad4-79027b1934db tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:42.662220 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-926d55ab-074c-4e1b-9ad4-79027b1934db tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1241 microversion: 2.1 time: 0.250121 Oct 30 00:48:42.680766 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 25/48] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:42 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1241 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:42.695114 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-31394236-8a1e-4efd-90cc-da5f246210d5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:42.696003 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-31394236-8a1e-4efd-90cc-da5f246210d5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:42.704228 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-31394236-8a1e-4efd-90cc-da5f246210d5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:42.705145 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-31394236-8a1e-4efd-90cc-da5f246210d5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:42.705836 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-31394236-8a1e-4efd-90cc-da5f246210d5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:42.706821 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-31394236-8a1e-4efd-90cc-da5f246210d5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:42.708381 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-31394236-8a1e-4efd-90cc-da5f246210d5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:42.709150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-31394236-8a1e-4efd-90cc-da5f246210d5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:42.846440 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d4de3d15-2d61-4b55-b78e-d3c6b389e8cb tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:42.862057 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d4de3d15-2d61-4b55-b78e-d3c6b389e8cb tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.872956 Oct 30 00:48:42.867072 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 24/49] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:41 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:42.940756 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-31394236-8a1e-4efd-90cc-da5f246210d5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:42.955020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-31394236-8a1e-4efd-90cc-da5f246210d5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1279 microversion: 2.1 time: 0.268805 Oct 30 00:48:42.961105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 26/50] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:42 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1279 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:43.338620 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5e609d51-c479-453d-a41d-f35625457d6f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:43.339447 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5e609d51-c479-453d-a41d-f35625457d6f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:43.347125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5e609d51-c479-453d-a41d-f35625457d6f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:43.347696 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5e609d51-c479-453d-a41d-f35625457d6f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:43.363345 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5e609d51-c479-453d-a41d-f35625457d6f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:43.371380 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5e609d51-c479-453d-a41d-f35625457d6f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:43.371820 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5e609d51-c479-453d-a41d-f35625457d6f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:43.374257 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5e609d51-c479-453d-a41d-f35625457d6f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:43.702965 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ff1f0440-fe3a-4b4e-b58e-3a3363d1afb9 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:43.704591 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ff1f0440-fe3a-4b4e-b58e-3a3363d1afb9 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:43.722523 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ff1f0440-fe3a-4b4e-b58e-3a3363d1afb9 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:43.722523 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ff1f0440-fe3a-4b4e-b58e-3a3363d1afb9 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:43.722523 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ff1f0440-fe3a-4b4e-b58e-3a3363d1afb9 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:43.734726 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ff1f0440-fe3a-4b4e-b58e-3a3363d1afb9 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:43.741920 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ff1f0440-fe3a-4b4e-b58e-3a3363d1afb9 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:43.742709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ff1f0440-fe3a-4b4e-b58e-3a3363d1afb9 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:43.932205 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ff1f0440-fe3a-4b4e-b58e-3a3363d1afb9 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:43.953593 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ff1f0440-fe3a-4b4e-b58e-3a3363d1afb9 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1289 microversion: 2.1 time: 0.258356 Oct 30 00:48:43.978276 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 27/51] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:43 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1289 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:43.988545 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d5cabc08-96e2-4358-b72f-dcad74b36340 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:44.004359 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-d5cabc08-96e2-4358-b72f-dcad74b36340 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:44.022450 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d5cabc08-96e2-4358-b72f-dcad74b36340 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:44.027277 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d5cabc08-96e2-4358-b72f-dcad74b36340 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:44.027990 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d5cabc08-96e2-4358-b72f-dcad74b36340 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:44.029657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d5cabc08-96e2-4358-b72f-dcad74b36340 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:44.032306 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d5cabc08-96e2-4358-b72f-dcad74b36340 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:44.037142 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d5cabc08-96e2-4358-b72f-dcad74b36340 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:44.041164 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5e609d51-c479-453d-a41d-f35625457d6f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:44.073919 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5e609d51-c479-453d-a41d-f35625457d6f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:44.083227 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5e609d51-c479-453d-a41d-f35625457d6f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:44.090188 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5e609d51-c479-453d-a41d-f35625457d6f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.754581 Oct 30 00:48:44.112955 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 25/52] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:43 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:48:44.118527 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-34f277b5-90b3-4bb2-bca4-1fe5cce85e3f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:44.150089 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-34f277b5-90b3-4bb2-bca4-1fe5cce85e3f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:44.176391 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34f277b5-90b3-4bb2-bca4-1fe5cce85e3f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:44.177005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34f277b5-90b3-4bb2-bca4-1fe5cce85e3f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:44.182973 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34f277b5-90b3-4bb2-bca4-1fe5cce85e3f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:44.186055 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34f277b5-90b3-4bb2-bca4-1fe5cce85e3f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:44.188171 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34f277b5-90b3-4bb2-bca4-1fe5cce85e3f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:44.192305 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34f277b5-90b3-4bb2-bca4-1fe5cce85e3f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:44.460481 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-34f277b5-90b3-4bb2-bca4-1fe5cce85e3f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:44.497624 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-34f277b5-90b3-4bb2-bca4-1fe5cce85e3f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1279 microversion: 2.1 time: 0.366681 Oct 30 00:48:44.501265 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 26/53] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:44 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1279 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:44.691414 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-d5cabc08-96e2-4358-b72f-dcad74b36340 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:44.708528 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-d5cabc08-96e2-4358-b72f-dcad74b36340 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.726225 Oct 30 00:48:44.724111 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 28/54] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:43 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:44.769047 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-fb2bc744-e7ab-4580-b044-db45bb5f09a2 req-e03670cc-ca53-4d22-8a17-4cb394b99d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00747eb3-1c2b-40b2-8e0a-9c440529e833", "tag": "0b7471a7-8df2-4f56-8dad-8f89610685f3"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:48:44.774109 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=12 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:44.806738 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-fb2bc744-e7ab-4580-b044-db45bb5f09a2 req-e03670cc-ca53-4d22-8a17-4cb394b99d32 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:44.807580 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-fb2bc744-e7ab-4580-b044-db45bb5f09a2 req-e03670cc-ca53-4d22-8a17-4cb394b99d32 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:44.808445 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-fb2bc744-e7ab-4580-b044-db45bb5f09a2 req-e03670cc-ca53-4d22-8a17-4cb394b99d32 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:44.831737 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=69 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:44.894224 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-fb2bc744-e7ab-4580-b044-db45bb5f09a2 req-e03670cc-ca53-4d22-8a17-4cb394b99d32 service nova] Creating event network-changed:0b7471a7-8df2-4f56-8dad-8f89610685f3 for instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 on hv-cinder-86149 Oct 30 00:48:44.895170 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-fb2bc744-e7ab-4580-b044-db45bb5f09a2 req-e03670cc-ca53-4d22-8a17-4cb394b99d32 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125553) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 30 00:48:44.897467 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-fb2bc744-e7ab-4580-b044-db45bb5f09a2 req-e03670cc-ca53-4d22-8a17-4cb394b99d32 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125553) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 30 00:48:44.898747 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bf049c8f-6c87-4046-9373-fdf3dce7560d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:44.910168 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bf049c8f-6c87-4046-9373-fdf3dce7560d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:44.912378 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bf049c8f-6c87-4046-9373-fdf3dce7560d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:44.915584 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bf049c8f-6c87-4046-9373-fdf3dce7560d None None] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:44.916281 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bf049c8f-6c87-4046-9373-fdf3dce7560d None None] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:44.916863 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bf049c8f-6c87-4046-9373-fdf3dce7560d None None] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:44.935423 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=9 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:44.943145 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.compute.rpcapi [None req-bf049c8f-6c87-4046-9373-fdf3dce7560d None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 30 00:48:44.944057 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bf049c8f-6c87-4046-9373-fdf3dce7560d None None] Releasing lock "compute-rpcapi-router" {{(pid=125553) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 30 00:48:44.979337 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-fc8226c0-193e-4477-aa8f-4898c2630ace tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:44.979919 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-fc8226c0-193e-4477-aa8f-4898c2630ace tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:44.990121 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fc8226c0-193e-4477-aa8f-4898c2630ace tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:44.993582 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fc8226c0-193e-4477-aa8f-4898c2630ace tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:44.994051 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fc8226c0-193e-4477-aa8f-4898c2630ace tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:44.994674 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-bf049c8f-6c87-4046-9373-fdf3dce7560d None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.490878 Oct 30 00:48:44.995697 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 27/55] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:48:44.996007 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fc8226c0-193e-4477-aa8f-4898c2630ace tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:44.996753 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fc8226c0-193e-4477-aa8f-4898c2630ace tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:44.997742 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fc8226c0-193e-4477-aa8f-4898c2630ace tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:45.141743 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-ec67c2fe-2d0d-4f38-91f4-d65c2e58b89f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:45.142620 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-ec67c2fe-2d0d-4f38-91f4-d65c2e58b89f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:45.161382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ec67c2fe-2d0d-4f38-91f4-d65c2e58b89f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:45.162210 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ec67c2fe-2d0d-4f38-91f4-d65c2e58b89f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:45.162864 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ec67c2fe-2d0d-4f38-91f4-d65c2e58b89f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:45.167926 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-fc8226c0-193e-4477-aa8f-4898c2630ace tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:45.171971 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ec67c2fe-2d0d-4f38-91f4-d65c2e58b89f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:45.173414 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ec67c2fe-2d0d-4f38-91f4-d65c2e58b89f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:45.175830 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ec67c2fe-2d0d-4f38-91f4-d65c2e58b89f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:45.186189 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-fc8226c0-193e-4477-aa8f-4898c2630ace tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1307 microversion: 2.1 time: 0.208714 Oct 30 00:48:45.202447 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 29/56] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:44 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1307 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:48:45.458171 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ec67c2fe-2d0d-4f38-91f4-d65c2e58b89f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:45.477408 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ec67c2fe-2d0d-4f38-91f4-d65c2e58b89f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:45.478982 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ec67c2fe-2d0d-4f38-91f4-d65c2e58b89f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:45.480282 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-ec67c2fe-2d0d-4f38-91f4-d65c2e58b89f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.343997 Oct 30 00:48:45.507713 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 28/57] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:45 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:48:45.526831 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-593da9d1-0ee3-4151-88d9-bf76e7dd2df5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:45.527590 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-593da9d1-0ee3-4151-88d9-bf76e7dd2df5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:45.535913 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-593da9d1-0ee3-4151-88d9-bf76e7dd2df5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:45.536762 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-593da9d1-0ee3-4151-88d9-bf76e7dd2df5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:45.537541 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-593da9d1-0ee3-4151-88d9-bf76e7dd2df5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:45.538527 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-593da9d1-0ee3-4151-88d9-bf76e7dd2df5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:45.539270 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-593da9d1-0ee3-4151-88d9-bf76e7dd2df5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:45.540049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-593da9d1-0ee3-4151-88d9-bf76e7dd2df5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:45.631677 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-593da9d1-0ee3-4151-88d9-bf76e7dd2df5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:45.643233 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-593da9d1-0ee3-4151-88d9-bf76e7dd2df5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1279 microversion: 2.1 time: 0.121456 Oct 30 00:48:45.664327 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 30/58] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:45 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1279 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:45.745150 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c4407142-b142-4c87-a63e-e85af552423e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:45.746980 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-c4407142-b142-4c87-a63e-e85af552423e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:45.776234 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c4407142-b142-4c87-a63e-e85af552423e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:45.777108 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c4407142-b142-4c87-a63e-e85af552423e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:45.777734 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c4407142-b142-4c87-a63e-e85af552423e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:45.778744 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c4407142-b142-4c87-a63e-e85af552423e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:45.782408 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c4407142-b142-4c87-a63e-e85af552423e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:45.783841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c4407142-b142-4c87-a63e-e85af552423e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:46.101529 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c4407142-b142-4c87-a63e-e85af552423e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:46.111341 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c4407142-b142-4c87-a63e-e85af552423e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.375495 Oct 30 00:48:46.111916 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 29/59] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:45 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:46.226939 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-49952142-219e-402e-aed3-64b021155284 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:46.228331 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-49952142-219e-402e-aed3-64b021155284 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:46.238008 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-49952142-219e-402e-aed3-64b021155284 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:46.238499 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-49952142-219e-402e-aed3-64b021155284 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:46.241027 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-49952142-219e-402e-aed3-64b021155284 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:46.243111 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-49952142-219e-402e-aed3-64b021155284 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:46.244167 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-49952142-219e-402e-aed3-64b021155284 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:46.244744 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-49952142-219e-402e-aed3-64b021155284 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:46.351527 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-49952142-219e-402e-aed3-64b021155284 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:46.361271 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-49952142-219e-402e-aed3-64b021155284 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1295 microversion: 2.1 time: 0.138263 Oct 30 00:48:46.362168 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 31/60] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:46 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1295 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:46.506375 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-2258f306-33d7-490d-beea-d1bd82df92c9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:46.507061 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-2258f306-33d7-490d-beea-d1bd82df92c9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:46.525241 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2258f306-33d7-490d-beea-d1bd82df92c9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:46.525839 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2258f306-33d7-490d-beea-d1bd82df92c9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:46.526282 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2258f306-33d7-490d-beea-d1bd82df92c9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:46.526987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2258f306-33d7-490d-beea-d1bd82df92c9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:46.536845 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2258f306-33d7-490d-beea-d1bd82df92c9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:46.539210 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2258f306-33d7-490d-beea-d1bd82df92c9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:46.670066 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-09b3cc85-0099-42bc-a148-e4abcbd096e5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:46.671054 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-09b3cc85-0099-42bc-a148-e4abcbd096e5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:46.686600 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-09b3cc85-0099-42bc-a148-e4abcbd096e5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:46.693214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-09b3cc85-0099-42bc-a148-e4abcbd096e5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:46.693992 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-09b3cc85-0099-42bc-a148-e4abcbd096e5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:46.695062 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-09b3cc85-0099-42bc-a148-e4abcbd096e5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:46.695734 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-09b3cc85-0099-42bc-a148-e4abcbd096e5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:46.696395 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-09b3cc85-0099-42bc-a148-e4abcbd096e5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:46.759975 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=100 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:47.243743 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-2258f306-33d7-490d-beea-d1bd82df92c9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:47.271932 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-2258f306-33d7-490d-beea-d1bd82df92c9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:47.274197 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-2258f306-33d7-490d-beea-d1bd82df92c9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:47.277979 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-2258f306-33d7-490d-beea-d1bd82df92c9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.775913 Oct 30 00:48:47.283417 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 30/61] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:46 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:48:47.300907 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-832e88e7-c004-450d-a79d-ca91486eb887 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:47.301531 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-832e88e7-c004-450d-a79d-ca91486eb887 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:47.327457 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=28 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:47.352395 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-832e88e7-c004-450d-a79d-ca91486eb887 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:47.352895 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-832e88e7-c004-450d-a79d-ca91486eb887 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:47.365512 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-832e88e7-c004-450d-a79d-ca91486eb887 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:47.368774 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-832e88e7-c004-450d-a79d-ca91486eb887 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:47.369726 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-832e88e7-c004-450d-a79d-ca91486eb887 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:47.381463 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-832e88e7-c004-450d-a79d-ca91486eb887 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:47.383449 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-09b3cc85-0099-42bc-a148-e4abcbd096e5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:47.417911 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-09b3cc85-0099-42bc-a148-e4abcbd096e5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.745480 Oct 30 00:48:47.418923 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 32/62] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:46 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:48:47.431340 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-b83b750e-32ae-41c0-9545-464d88e5bf36 req-d780e35e-5c52-4bef-9797-cb2029233b08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa96626-2d37-41bc-8beb-ed93a5a90f85", "tag": "b4275094-f698-4ced-a85a-305d1f639c55"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:48:47.492748 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-b83b750e-32ae-41c0-9545-464d88e5bf36 req-d780e35e-5c52-4bef-9797-cb2029233b08 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:47.493745 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-b83b750e-32ae-41c0-9545-464d88e5bf36 req-d780e35e-5c52-4bef-9797-cb2029233b08 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:47.494393 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-b83b750e-32ae-41c0-9545-464d88e5bf36 req-d780e35e-5c52-4bef-9797-cb2029233b08 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:47.527672 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-b83b750e-32ae-41c0-9545-464d88e5bf36 req-d780e35e-5c52-4bef-9797-cb2029233b08 service nova] Creating event network-changed:b4275094-f698-4ced-a85a-305d1f639c55 for instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 on hv-cinder-86149 Oct 30 00:48:47.529043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-b83b750e-32ae-41c0-9545-464d88e5bf36 req-d780e35e-5c52-4bef-9797-cb2029233b08 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125554) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 30 00:48:47.529675 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-b83b750e-32ae-41c0-9545-464d88e5bf36 req-d780e35e-5c52-4bef-9797-cb2029233b08 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125554) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 30 00:48:47.531060 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-69955228-b7aa-473d-97db-8a9b350febeb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:47.531688 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-69955228-b7aa-473d-97db-8a9b350febeb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:47.532345 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-69955228-b7aa-473d-97db-8a9b350febeb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:47.536888 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-69955228-b7aa-473d-97db-8a9b350febeb None None] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:47.536888 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-69955228-b7aa-473d-97db-8a9b350febeb None None] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:47.536888 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-69955228-b7aa-473d-97db-8a9b350febeb None None] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:47.550467 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.compute.rpcapi [None req-69955228-b7aa-473d-97db-8a9b350febeb None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 30 00:48:47.551384 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-69955228-b7aa-473d-97db-8a9b350febeb None None] Releasing lock "compute-rpcapi-router" {{(pid=125554) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 30 00:48:47.587370 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-69955228-b7aa-473d-97db-8a9b350febeb None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164738 Oct 30 00:48:47.595037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 33/63] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:48:47.604268 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-48b4dd0a-c9e3-4e54-ae19-7256c1eb20c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:47.605225 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-48b4dd0a-c9e3-4e54-ae19-7256c1eb20c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:47.614283 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-48b4dd0a-c9e3-4e54-ae19-7256c1eb20c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:47.615346 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-48b4dd0a-c9e3-4e54-ae19-7256c1eb20c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:47.616254 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-48b4dd0a-c9e3-4e54-ae19-7256c1eb20c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:47.617776 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-48b4dd0a-c9e3-4e54-ae19-7256c1eb20c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:47.618390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-48b4dd0a-c9e3-4e54-ae19-7256c1eb20c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:47.619000 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-48b4dd0a-c9e3-4e54-ae19-7256c1eb20c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:47.773926 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-48b4dd0a-c9e3-4e54-ae19-7256c1eb20c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:47.786829 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-48b4dd0a-c9e3-4e54-ae19-7256c1eb20c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1295 microversion: 2.1 time: 0.189741 Oct 30 00:48:47.788745 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 34/64] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:47 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1295 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:47.827785 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-832e88e7-c004-450d-a79d-ca91486eb887 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:47.837426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-832e88e7-c004-450d-a79d-ca91486eb887 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.552936 Oct 30 00:48:47.837999 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 31/65] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:47 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:48.309333 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-38c3c1a9-64aa-407a-a35d-7588bb602a45 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:48.310872 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-38c3c1a9-64aa-407a-a35d-7588bb602a45 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:48.321038 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-38c3c1a9-64aa-407a-a35d-7588bb602a45 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:48.322124 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-38c3c1a9-64aa-407a-a35d-7588bb602a45 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:48.322794 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-38c3c1a9-64aa-407a-a35d-7588bb602a45 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:48.323778 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-38c3c1a9-64aa-407a-a35d-7588bb602a45 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:48.324887 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-38c3c1a9-64aa-407a-a35d-7588bb602a45 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:48.326981 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-38c3c1a9-64aa-407a-a35d-7588bb602a45 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:48.449015 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-afed3051-19be-4185-b843-cf856a8c56f3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:48.449752 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-afed3051-19be-4185-b843-cf856a8c56f3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:48.473290 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-afed3051-19be-4185-b843-cf856a8c56f3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:48.474109 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-afed3051-19be-4185-b843-cf856a8c56f3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:48.474895 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-afed3051-19be-4185-b843-cf856a8c56f3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:48.475791 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-afed3051-19be-4185-b843-cf856a8c56f3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:48.476938 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-afed3051-19be-4185-b843-cf856a8c56f3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:48.478240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-afed3051-19be-4185-b843-cf856a8c56f3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:48.634331 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-38c3c1a9-64aa-407a-a35d-7588bb602a45 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:48.652539 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-38c3c1a9-64aa-407a-a35d-7588bb602a45 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:48.654740 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-38c3c1a9-64aa-407a-a35d-7588bb602a45 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:48.660665 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-38c3c1a9-64aa-407a-a35d-7588bb602a45 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.355157 Oct 30 00:48:48.661716 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 35/66] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:48 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:48:48.813521 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-000bf369-def2-4149-9af5-0a5ec32a5c09 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:48.814449 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-000bf369-def2-4149-9af5-0a5ec32a5c09 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:48.820570 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-000bf369-def2-4149-9af5-0a5ec32a5c09 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:48.821300 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-000bf369-def2-4149-9af5-0a5ec32a5c09 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:48.821843 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-000bf369-def2-4149-9af5-0a5ec32a5c09 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:48.822718 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-000bf369-def2-4149-9af5-0a5ec32a5c09 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:48.823425 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-000bf369-def2-4149-9af5-0a5ec32a5c09 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:48.823929 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-000bf369-def2-4149-9af5-0a5ec32a5c09 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:48.923407 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-afed3051-19be-4185-b843-cf856a8c56f3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:48.938094 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-afed3051-19be-4185-b843-cf856a8c56f3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.499116 Oct 30 00:48:48.948489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 32/67] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:48 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:48.962487 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-98ca0281-81eb-4382-9818-de32c1311cc2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:48.963439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-98ca0281-81eb-4382-9818-de32c1311cc2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:48.971142 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-98ca0281-81eb-4382-9818-de32c1311cc2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:48.971998 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-98ca0281-81eb-4382-9818-de32c1311cc2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:48.972713 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-98ca0281-81eb-4382-9818-de32c1311cc2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:48.978171 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-98ca0281-81eb-4382-9818-de32c1311cc2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:48.979270 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-98ca0281-81eb-4382-9818-de32c1311cc2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:48.979922 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-98ca0281-81eb-4382-9818-de32c1311cc2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:49.218439 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-000bf369-def2-4149-9af5-0a5ec32a5c09 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:49.227421 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-000bf369-def2-4149-9af5-0a5ec32a5c09 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.417998 Oct 30 00:48:49.231104 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 36/68] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:48 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:49.287151 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-98ca0281-81eb-4382-9818-de32c1311cc2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:49.304482 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-98ca0281-81eb-4382-9818-de32c1311cc2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.353582 Oct 30 00:48:49.320717 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 33/69] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:48 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:49.692580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4961352d-8066-4dcb-a631-3a0481caa88d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:49.693203 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-4961352d-8066-4dcb-a631-3a0481caa88d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:49.709087 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4961352d-8066-4dcb-a631-3a0481caa88d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:49.710901 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4961352d-8066-4dcb-a631-3a0481caa88d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:49.712316 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4961352d-8066-4dcb-a631-3a0481caa88d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:49.714221 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4961352d-8066-4dcb-a631-3a0481caa88d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:49.714695 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4961352d-8066-4dcb-a631-3a0481caa88d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:49.715163 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4961352d-8066-4dcb-a631-3a0481caa88d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:49.724824 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-51a04bb6-7759-4b58-a8c7-5df5ff565c1c req-0307045f-a3c0-4eaf-b871-2d6a5b7e4669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1bf0cdf-a838-4e0c-a56f-707f90711978", "tag": "1a9df18b-56de-4bc7-8368-87528ddf8143"}, {"name": "network-changed", "server_uuid": "fc267534-c882-4793-a8f9-17df60c7fa64", "tag": "7ec2e88e-6952-48c2-a06d-48ad36a8fe11"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:48:49.750670 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-51a04bb6-7759-4b58-a8c7-5df5ff565c1c req-0307045f-a3c0-4eaf-b871-2d6a5b7e4669 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:49.751167 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-51a04bb6-7759-4b58-a8c7-5df5ff565c1c req-0307045f-a3c0-4eaf-b871-2d6a5b7e4669 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:49.755268 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-51a04bb6-7759-4b58-a8c7-5df5ff565c1c req-0307045f-a3c0-4eaf-b871-2d6a5b7e4669 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:49.792632 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-51a04bb6-7759-4b58-a8c7-5df5ff565c1c req-0307045f-a3c0-4eaf-b871-2d6a5b7e4669 service nova] Creating event network-changed:1a9df18b-56de-4bc7-8368-87528ddf8143 for instance a1bf0cdf-a838-4e0c-a56f-707f90711978 on hv-cinder-86149 Oct 30 00:48:49.795327 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-51a04bb6-7759-4b58-a8c7-5df5ff565c1c req-0307045f-a3c0-4eaf-b871-2d6a5b7e4669 service nova] Creating event network-changed:7ec2e88e-6952-48c2-a06d-48ad36a8fe11 for instance fc267534-c882-4793-a8f9-17df60c7fa64 on hv-cinder-86149 Oct 30 00:48:49.806645 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-51a04bb6-7759-4b58-a8c7-5df5ff565c1c req-0307045f-a3c0-4eaf-b871-2d6a5b7e4669 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.086852 Oct 30 00:48:49.808608 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 34/70] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:48:49.969260 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-df98c8f1-667d-4414-82a5-4e6198c17dd4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:49.971057 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-df98c8f1-667d-4414-82a5-4e6198c17dd4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:49.997386 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-df98c8f1-667d-4414-82a5-4e6198c17dd4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:49.997386 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-df98c8f1-667d-4414-82a5-4e6198c17dd4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:49.997386 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-df98c8f1-667d-4414-82a5-4e6198c17dd4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:49.997386 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-df98c8f1-667d-4414-82a5-4e6198c17dd4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:50.000401 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-df98c8f1-667d-4414-82a5-4e6198c17dd4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:50.001462 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-df98c8f1-667d-4414-82a5-4e6198c17dd4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:50.079296 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4961352d-8066-4dcb-a631-3a0481caa88d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:50.087989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4961352d-8066-4dcb-a631-3a0481caa88d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:50.093492 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4961352d-8066-4dcb-a631-3a0481caa88d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:50.097438 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-4961352d-8066-4dcb-a631-3a0481caa88d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.407217 Oct 30 00:48:50.098237 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 37/71] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:49 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:48:50.258386 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-70c53fdd-59c5-4dfd-a7cc-e66e26fc3762 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:50.259052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-70c53fdd-59c5-4dfd-a7cc-e66e26fc3762 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:50.269110 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-70c53fdd-59c5-4dfd-a7cc-e66e26fc3762 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:50.270398 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-70c53fdd-59c5-4dfd-a7cc-e66e26fc3762 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:50.270846 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-70c53fdd-59c5-4dfd-a7cc-e66e26fc3762 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:50.273567 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-70c53fdd-59c5-4dfd-a7cc-e66e26fc3762 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:50.274242 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-70c53fdd-59c5-4dfd-a7cc-e66e26fc3762 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:50.276102 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-70c53fdd-59c5-4dfd-a7cc-e66e26fc3762 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:50.339777 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-df98c8f1-667d-4414-82a5-4e6198c17dd4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:50.348588 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-df98c8f1-667d-4414-82a5-4e6198c17dd4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.388438 Oct 30 00:48:50.349229 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 35/72] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:49 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:50.363642 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-b5274837-572a-4121-a23a-69a1e29e55ab tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:50.364344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-b5274837-572a-4121-a23a-69a1e29e55ab tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:50.371564 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b5274837-572a-4121-a23a-69a1e29e55ab tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:50.371564 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b5274837-572a-4121-a23a-69a1e29e55ab tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:50.371564 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b5274837-572a-4121-a23a-69a1e29e55ab tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:50.372835 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b5274837-572a-4121-a23a-69a1e29e55ab tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:50.373508 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b5274837-572a-4121-a23a-69a1e29e55ab tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:50.373952 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b5274837-572a-4121-a23a-69a1e29e55ab tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:50.693504 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-70c53fdd-59c5-4dfd-a7cc-e66e26fc3762 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:50.699038 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-b5274837-572a-4121-a23a-69a1e29e55ab tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:50.716769 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-b5274837-572a-4121-a23a-69a1e29e55ab tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.358747 Oct 30 00:48:50.732392 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-70c53fdd-59c5-4dfd-a7cc-e66e26fc3762 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.461367 Oct 30 00:48:50.739562 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 38/73] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:50 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:48:50.740138 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 36/74] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:50 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:51.124588 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f37383ca-a503-4dfa-9b36-d20b380f60d6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:51.125817 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-f37383ca-a503-4dfa-9b36-d20b380f60d6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:51.144835 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f37383ca-a503-4dfa-9b36-d20b380f60d6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:51.145788 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f37383ca-a503-4dfa-9b36-d20b380f60d6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:51.146558 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f37383ca-a503-4dfa-9b36-d20b380f60d6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:51.147673 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f37383ca-a503-4dfa-9b36-d20b380f60d6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:51.148291 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f37383ca-a503-4dfa-9b36-d20b380f60d6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:51.148848 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f37383ca-a503-4dfa-9b36-d20b380f60d6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:51.330394 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-f37383ca-a503-4dfa-9b36-d20b380f60d6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:51.352989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-f37383ca-a503-4dfa-9b36-d20b380f60d6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:51.354894 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-f37383ca-a503-4dfa-9b36-d20b380f60d6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:51.359540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-f37383ca-a503-4dfa-9b36-d20b380f60d6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.240349 Oct 30 00:48:51.370331 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 39/75] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:51 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:48:51.375405 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-c8f0e996-0a67-4d65-aaf2-af9a3120297c req-60a54a0c-7647-45e8-8216-35ab76919e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4250f845-2f85-48d9-bf11-5b7093520b26", "tag": "bc753166-f353-4e52-8984-d2a862e879f6"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:48:51.383049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ab65534d-2d10-402d-b1aa-417257e1b2ae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:51.384023 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ab65534d-2d10-402d-b1aa-417257e1b2ae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:51.385460 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-c8f0e996-0a67-4d65-aaf2-af9a3120297c req-60a54a0c-7647-45e8-8216-35ab76919e2d service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:51.386093 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-c8f0e996-0a67-4d65-aaf2-af9a3120297c req-60a54a0c-7647-45e8-8216-35ab76919e2d service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:51.386770 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-c8f0e996-0a67-4d65-aaf2-af9a3120297c req-60a54a0c-7647-45e8-8216-35ab76919e2d service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:51.391363 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=7 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:51.394010 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ab65534d-2d10-402d-b1aa-417257e1b2ae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:51.394603 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ab65534d-2d10-402d-b1aa-417257e1b2ae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:51.395126 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ab65534d-2d10-402d-b1aa-417257e1b2ae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:51.396012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ab65534d-2d10-402d-b1aa-417257e1b2ae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:51.396572 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ab65534d-2d10-402d-b1aa-417257e1b2ae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:51.397107 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ab65534d-2d10-402d-b1aa-417257e1b2ae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:51.400322 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-c8f0e996-0a67-4d65-aaf2-af9a3120297c req-60a54a0c-7647-45e8-8216-35ab76919e2d service nova] Creating event network-changed:bc753166-f353-4e52-8984-d2a862e879f6 for instance 4250f845-2f85-48d9-bf11-5b7093520b26 on hv-cinder-86149 Oct 30 00:48:51.409551 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-c8f0e996-0a67-4d65-aaf2-af9a3120297c req-60a54a0c-7647-45e8-8216-35ab76919e2d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.276016 Oct 30 00:48:51.411864 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 37/76] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:48:51.745794 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ab65534d-2d10-402d-b1aa-417257e1b2ae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:51.751997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f6c8098f-ef9d-4525-a69c-b6d1b9925593 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:51.752871 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f6c8098f-ef9d-4525-a69c-b6d1b9925593 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:51.760049 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6c8098f-ef9d-4525-a69c-b6d1b9925593 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:51.760933 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6c8098f-ef9d-4525-a69c-b6d1b9925593 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:51.761478 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6c8098f-ef9d-4525-a69c-b6d1b9925593 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:51.762207 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ab65534d-2d10-402d-b1aa-417257e1b2ae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.383017 Oct 30 00:48:51.763350 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6c8098f-ef9d-4525-a69c-b6d1b9925593 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:51.771538 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 40/77] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:51 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:51.772935 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6c8098f-ef9d-4525-a69c-b6d1b9925593 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:51.773481 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6c8098f-ef9d-4525-a69c-b6d1b9925593 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:51.782741 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-78754ab3-4b35-4d64-95d2-5c3e4da22707 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:51.782741 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-78754ab3-4b35-4d64-95d2-5c3e4da22707 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:51.804223 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78754ab3-4b35-4d64-95d2-5c3e4da22707 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:51.805069 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78754ab3-4b35-4d64-95d2-5c3e4da22707 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:51.806550 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78754ab3-4b35-4d64-95d2-5c3e4da22707 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:51.807276 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78754ab3-4b35-4d64-95d2-5c3e4da22707 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:51.807729 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78754ab3-4b35-4d64-95d2-5c3e4da22707 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:51.808174 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78754ab3-4b35-4d64-95d2-5c3e4da22707 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:52.032283 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-78754ab3-4b35-4d64-95d2-5c3e4da22707 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:52.032805 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f6c8098f-ef9d-4525-a69c-b6d1b9925593 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:52.051195 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-78754ab3-4b35-4d64-95d2-5c3e4da22707 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.286083 Oct 30 00:48:52.067154 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f6c8098f-ef9d-4525-a69c-b6d1b9925593 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.317409 Oct 30 00:48:52.068557 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 41/78] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:51 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:52.068936 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 38/79] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:51 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:52.389226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-88c22dc1-979c-4122-bb81-6c5d6d1eb021 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:52.390476 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-88c22dc1-979c-4122-bb81-6c5d6d1eb021 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:52.397603 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-88c22dc1-979c-4122-bb81-6c5d6d1eb021 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:52.398094 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-88c22dc1-979c-4122-bb81-6c5d6d1eb021 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:52.398533 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-88c22dc1-979c-4122-bb81-6c5d6d1eb021 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:52.400297 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-88c22dc1-979c-4122-bb81-6c5d6d1eb021 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:52.400297 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-88c22dc1-979c-4122-bb81-6c5d6d1eb021 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:52.400297 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-88c22dc1-979c-4122-bb81-6c5d6d1eb021 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:52.545322 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-88c22dc1-979c-4122-bb81-6c5d6d1eb021 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:52.553299 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-88c22dc1-979c-4122-bb81-6c5d6d1eb021 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:52.554746 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-88c22dc1-979c-4122-bb81-6c5d6d1eb021 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:52.555872 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-88c22dc1-979c-4122-bb81-6c5d6d1eb021 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.170888 Oct 30 00:48:52.556465 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 42/80] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:52 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:48:52.787503 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a4b5e1ed-fe70-4a42-b0f2-9fea6989c946 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:52.788155 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a4b5e1ed-fe70-4a42-b0f2-9fea6989c946 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:52.795143 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a4b5e1ed-fe70-4a42-b0f2-9fea6989c946 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:52.795488 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a4b5e1ed-fe70-4a42-b0f2-9fea6989c946 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:52.795923 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a4b5e1ed-fe70-4a42-b0f2-9fea6989c946 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:52.796635 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a4b5e1ed-fe70-4a42-b0f2-9fea6989c946 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:52.797083 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a4b5e1ed-fe70-4a42-b0f2-9fea6989c946 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:52.797501 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a4b5e1ed-fe70-4a42-b0f2-9fea6989c946 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:52.927706 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a4b5e1ed-fe70-4a42-b0f2-9fea6989c946 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:52.935691 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a4b5e1ed-fe70-4a42-b0f2-9fea6989c946 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.151981 Oct 30 00:48:52.936279 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 39/81] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:52 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:53.074679 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b5e8cf1f-ddca-4f16-b024-dd81135e8689 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:53.075787 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-b5e8cf1f-ddca-4f16-b024-dd81135e8689 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:53.079908 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-7d51ef61-df4c-47c1-87b3-b94d73a7a19d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:53.080557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-7d51ef61-df4c-47c1-87b3-b94d73a7a19d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:53.081950 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5e8cf1f-ddca-4f16-b024-dd81135e8689 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:53.082438 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5e8cf1f-ddca-4f16-b024-dd81135e8689 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:53.082872 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5e8cf1f-ddca-4f16-b024-dd81135e8689 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:53.083572 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5e8cf1f-ddca-4f16-b024-dd81135e8689 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:53.084025 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5e8cf1f-ddca-4f16-b024-dd81135e8689 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:53.084474 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5e8cf1f-ddca-4f16-b024-dd81135e8689 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:53.086478 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7d51ef61-df4c-47c1-87b3-b94d73a7a19d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:53.086962 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7d51ef61-df4c-47c1-87b3-b94d73a7a19d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:53.087391 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7d51ef61-df4c-47c1-87b3-b94d73a7a19d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:53.088075 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7d51ef61-df4c-47c1-87b3-b94d73a7a19d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:53.088548 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7d51ef61-df4c-47c1-87b3-b94d73a7a19d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:53.088965 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7d51ef61-df4c-47c1-87b3-b94d73a7a19d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:53.282100 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-7d51ef61-df4c-47c1-87b3-b94d73a7a19d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:53.286191 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b5e8cf1f-ddca-4f16-b024-dd81135e8689 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:53.293352 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-7d51ef61-df4c-47c1-87b3-b94d73a7a19d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.216988 Oct 30 00:48:53.294165 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 40/82] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:53 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:48:53.295303 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b5e8cf1f-ddca-4f16-b024-dd81135e8689 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.224319 Oct 30 00:48:53.295867 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 43/83] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:53 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:53.581775 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-7db0c61f-9189-4905-8a33-fcb089e6d394 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:53.582403 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-7db0c61f-9189-4905-8a33-fcb089e6d394 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:53.588384 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7db0c61f-9189-4905-8a33-fcb089e6d394 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:53.588857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7db0c61f-9189-4905-8a33-fcb089e6d394 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:53.589284 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7db0c61f-9189-4905-8a33-fcb089e6d394 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:53.589968 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7db0c61f-9189-4905-8a33-fcb089e6d394 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:53.590403 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7db0c61f-9189-4905-8a33-fcb089e6d394 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:53.591333 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7db0c61f-9189-4905-8a33-fcb089e6d394 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:53.718545 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-7db0c61f-9189-4905-8a33-fcb089e6d394 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:53.726634 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-7db0c61f-9189-4905-8a33-fcb089e6d394 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:53.728072 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-7db0c61f-9189-4905-8a33-fcb089e6d394 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:53.729202 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-7db0c61f-9189-4905-8a33-fcb089e6d394 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.151320 Oct 30 00:48:53.729753 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 41/84] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:53 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:48:53.958843 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-03377c93-1e0e-489a-9cc4-f90f7dadaee5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:53.959557 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-03377c93-1e0e-489a-9cc4-f90f7dadaee5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:53.965522 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-03377c93-1e0e-489a-9cc4-f90f7dadaee5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:53.966698 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-03377c93-1e0e-489a-9cc4-f90f7dadaee5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:53.967136 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-03377c93-1e0e-489a-9cc4-f90f7dadaee5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:53.967822 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-03377c93-1e0e-489a-9cc4-f90f7dadaee5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:53.968310 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-03377c93-1e0e-489a-9cc4-f90f7dadaee5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:53.968759 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-03377c93-1e0e-489a-9cc4-f90f7dadaee5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:54.093336 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-03377c93-1e0e-489a-9cc4-f90f7dadaee5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:54.100879 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-03377c93-1e0e-489a-9cc4-f90f7dadaee5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.146296 Oct 30 00:48:54.101446 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 44/85] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:53 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:54.317128 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-0c845041-bdc5-4a36-abd3-6a4abbf6f930 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:54.317831 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-0c845041-bdc5-4a36-abd3-6a4abbf6f930 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:54.319164 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-6725407b-11fc-4fae-b53f-def0ac9d3732 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:54.319776 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-6725407b-11fc-4fae-b53f-def0ac9d3732 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:54.323718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0c845041-bdc5-4a36-abd3-6a4abbf6f930 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:54.324238 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0c845041-bdc5-4a36-abd3-6a4abbf6f930 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:54.324908 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0c845041-bdc5-4a36-abd3-6a4abbf6f930 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:54.325607 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0c845041-bdc5-4a36-abd3-6a4abbf6f930 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:54.325982 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6725407b-11fc-4fae-b53f-def0ac9d3732 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:54.326086 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0c845041-bdc5-4a36-abd3-6a4abbf6f930 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:54.326460 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6725407b-11fc-4fae-b53f-def0ac9d3732 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:54.326558 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0c845041-bdc5-4a36-abd3-6a4abbf6f930 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:54.326915 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6725407b-11fc-4fae-b53f-def0ac9d3732 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:54.327564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6725407b-11fc-4fae-b53f-def0ac9d3732 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:54.328458 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6725407b-11fc-4fae-b53f-def0ac9d3732 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:54.329036 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6725407b-11fc-4fae-b53f-def0ac9d3732 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:54.525137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-0c845041-bdc5-4a36-abd3-6a4abbf6f930 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:54.529096 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6725407b-11fc-4fae-b53f-def0ac9d3732 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:54.533866 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-0c845041-bdc5-4a36-abd3-6a4abbf6f930 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.220955 Oct 30 00:48:54.534431 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 42/86] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:54 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:54.537179 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-6725407b-11fc-4fae-b53f-def0ac9d3732 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.222354 Oct 30 00:48:54.537802 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 45/87] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:54 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:48:54.754215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a70b014f-53c6-40a7-a503-5f1d89030ec3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:54.754810 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a70b014f-53c6-40a7-a503-5f1d89030ec3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:54.760688 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a70b014f-53c6-40a7-a503-5f1d89030ec3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:54.761158 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a70b014f-53c6-40a7-a503-5f1d89030ec3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:54.761597 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a70b014f-53c6-40a7-a503-5f1d89030ec3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:54.762253 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a70b014f-53c6-40a7-a503-5f1d89030ec3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:54.763191 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a70b014f-53c6-40a7-a503-5f1d89030ec3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:54.763601 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a70b014f-53c6-40a7-a503-5f1d89030ec3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:54.899830 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a70b014f-53c6-40a7-a503-5f1d89030ec3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:54.908608 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a70b014f-53c6-40a7-a503-5f1d89030ec3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:54.910032 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a70b014f-53c6-40a7-a503-5f1d89030ec3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:54.911160 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a70b014f-53c6-40a7-a503-5f1d89030ec3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.160728 Oct 30 00:48:54.911740 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 43/88] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:54 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:48:55.124625 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b40b1b7b-75ad-4315-bbad-ea3401e10319 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:55.125138 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-b40b1b7b-75ad-4315-bbad-ea3401e10319 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:55.131025 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b40b1b7b-75ad-4315-bbad-ea3401e10319 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:55.131494 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b40b1b7b-75ad-4315-bbad-ea3401e10319 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:55.131918 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b40b1b7b-75ad-4315-bbad-ea3401e10319 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:55.132620 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b40b1b7b-75ad-4315-bbad-ea3401e10319 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:55.133065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b40b1b7b-75ad-4315-bbad-ea3401e10319 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:55.133482 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b40b1b7b-75ad-4315-bbad-ea3401e10319 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:55.266157 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b40b1b7b-75ad-4315-bbad-ea3401e10319 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:55.273853 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b40b1b7b-75ad-4315-bbad-ea3401e10319 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.154650 Oct 30 00:48:55.274411 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 46/89] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:55 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:55.557285 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-b5af7d57-35bb-42b1-9c19-4b6523ae0ecb tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:55.557907 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-b5af7d57-35bb-42b1-9c19-4b6523ae0ecb tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:55.560626 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-cf33e317-bd2c-4af9-a8fa-a2810aba4214 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:55.561246 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-cf33e317-bd2c-4af9-a8fa-a2810aba4214 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:55.562990 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:55.568615 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cf33e317-bd2c-4af9-a8fa-a2810aba4214 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:55.569024 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cf33e317-bd2c-4af9-a8fa-a2810aba4214 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:55.569324 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b5af7d57-35bb-42b1-9c19-4b6523ae0ecb tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:55.569771 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cf33e317-bd2c-4af9-a8fa-a2810aba4214 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:55.569915 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b5af7d57-35bb-42b1-9c19-4b6523ae0ecb tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:55.570228 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b5af7d57-35bb-42b1-9c19-4b6523ae0ecb tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:55.570477 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cf33e317-bd2c-4af9-a8fa-a2810aba4214 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:55.570939 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b5af7d57-35bb-42b1-9c19-4b6523ae0ecb tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:55.571045 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cf33e317-bd2c-4af9-a8fa-a2810aba4214 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:55.571393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b5af7d57-35bb-42b1-9c19-4b6523ae0ecb tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:55.571560 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cf33e317-bd2c-4af9-a8fa-a2810aba4214 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:55.571977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b5af7d57-35bb-42b1-9c19-4b6523ae0ecb tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:55.817138 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-cf33e317-bd2c-4af9-a8fa-a2810aba4214 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:55.821420 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-b5af7d57-35bb-42b1-9c19-4b6523ae0ecb tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:55.836675 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-b5af7d57-35bb-42b1-9c19-4b6523ae0ecb tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.283061 Oct 30 00:48:55.840286 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 44/90] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:55 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:48:55.842446 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-cf33e317-bd2c-4af9-a8fa-a2810aba4214 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.284779 Oct 30 00:48:55.843398 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 47/91] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:55 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:48:55.936268 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-210bd431-c038-49d0-9d5b-9d61e5f2cbea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:55.938145 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-210bd431-c038-49d0-9d5b-9d61e5f2cbea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:55.944027 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-210bd431-c038-49d0-9d5b-9d61e5f2cbea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:55.944541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-210bd431-c038-49d0-9d5b-9d61e5f2cbea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:55.944970 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-210bd431-c038-49d0-9d5b-9d61e5f2cbea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:55.945662 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-210bd431-c038-49d0-9d5b-9d61e5f2cbea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:55.946108 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-210bd431-c038-49d0-9d5b-9d61e5f2cbea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:55.946523 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-210bd431-c038-49d0-9d5b-9d61e5f2cbea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:55.964531 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=100 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:56.114884 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-210bd431-c038-49d0-9d5b-9d61e5f2cbea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:56.123940 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-210bd431-c038-49d0-9d5b-9d61e5f2cbea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:56.125515 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-210bd431-c038-49d0-9d5b-9d61e5f2cbea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:56.126704 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-210bd431-c038-49d0-9d5b-9d61e5f2cbea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.194329 Oct 30 00:48:56.127239 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 45/92] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:55 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:48:56.297710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-394304bf-7554-4e43-836c-7d3d76251631 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:56.298573 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-394304bf-7554-4e43-836c-7d3d76251631 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:56.305634 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-394304bf-7554-4e43-836c-7d3d76251631 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:56.306117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-394304bf-7554-4e43-836c-7d3d76251631 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:56.306548 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-394304bf-7554-4e43-836c-7d3d76251631 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:56.307249 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-394304bf-7554-4e43-836c-7d3d76251631 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:56.307698 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-394304bf-7554-4e43-836c-7d3d76251631 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:56.308137 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-394304bf-7554-4e43-836c-7d3d76251631 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:56.445237 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-394304bf-7554-4e43-836c-7d3d76251631 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:56.454281 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-394304bf-7554-4e43-836c-7d3d76251631 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.161154 Oct 30 00:48:56.454853 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 48/93] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:56 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:56.863129 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-fdcf7bd4-ed4a-4e3a-871e-f4dda271141e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:56.864565 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-fdcf7bd4-ed4a-4e3a-871e-f4dda271141e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:56.867262 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-38defcf5-076a-4b84-b838-4d352d99554a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:56.869028 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-38defcf5-076a-4b84-b838-4d352d99554a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:56.871186 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fdcf7bd4-ed4a-4e3a-871e-f4dda271141e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:56.871675 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fdcf7bd4-ed4a-4e3a-871e-f4dda271141e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:56.872117 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fdcf7bd4-ed4a-4e3a-871e-f4dda271141e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:56.872850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fdcf7bd4-ed4a-4e3a-871e-f4dda271141e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:56.873291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fdcf7bd4-ed4a-4e3a-871e-f4dda271141e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:56.873708 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fdcf7bd4-ed4a-4e3a-871e-f4dda271141e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:56.874513 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-38defcf5-076a-4b84-b838-4d352d99554a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:56.875004 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-38defcf5-076a-4b84-b838-4d352d99554a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:56.875435 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-38defcf5-076a-4b84-b838-4d352d99554a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:56.876163 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-38defcf5-076a-4b84-b838-4d352d99554a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:56.877221 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-38defcf5-076a-4b84-b838-4d352d99554a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:56.877647 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-38defcf5-076a-4b84-b838-4d352d99554a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:56.882358 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=100 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:57.071900 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fdcf7bd4-ed4a-4e3a-871e-f4dda271141e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:57.080163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-fdcf7bd4-ed4a-4e3a-871e-f4dda271141e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.221758 Oct 30 00:48:57.080694 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 46/94] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:56 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:57.083055 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-38defcf5-076a-4b84-b838-4d352d99554a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:57.090698 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-38defcf5-076a-4b84-b838-4d352d99554a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.227827 Oct 30 00:48:57.091818 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 49/95] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:56 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:48:57.154370 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a29ac954-f095-4ac3-a527-63c8d7ed048c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:57.154966 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a29ac954-f095-4ac3-a527-63c8d7ed048c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:57.160861 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a29ac954-f095-4ac3-a527-63c8d7ed048c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:57.161328 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a29ac954-f095-4ac3-a527-63c8d7ed048c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:57.161747 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a29ac954-f095-4ac3-a527-63c8d7ed048c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:57.162414 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a29ac954-f095-4ac3-a527-63c8d7ed048c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:57.162855 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a29ac954-f095-4ac3-a527-63c8d7ed048c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:57.163274 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a29ac954-f095-4ac3-a527-63c8d7ed048c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:57.289449 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a29ac954-f095-4ac3-a527-63c8d7ed048c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:57.298440 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a29ac954-f095-4ac3-a527-63c8d7ed048c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:57.299877 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a29ac954-f095-4ac3-a527-63c8d7ed048c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:57.301009 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a29ac954-f095-4ac3-a527-63c8d7ed048c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.151666 Oct 30 00:48:57.301562 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 47/96] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:57 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:48:57.476902 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-10e2d7b8-0e67-41db-ba49-96d0dc164e86 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:57.477657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-10e2d7b8-0e67-41db-ba49-96d0dc164e86 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:57.485249 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-10e2d7b8-0e67-41db-ba49-96d0dc164e86 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:57.485754 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-10e2d7b8-0e67-41db-ba49-96d0dc164e86 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:57.486197 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-10e2d7b8-0e67-41db-ba49-96d0dc164e86 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:57.487197 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-10e2d7b8-0e67-41db-ba49-96d0dc164e86 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:57.487960 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-10e2d7b8-0e67-41db-ba49-96d0dc164e86 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:57.488423 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-10e2d7b8-0e67-41db-ba49-96d0dc164e86 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:57.544029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=4 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:48:57.626705 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-10e2d7b8-0e67-41db-ba49-96d0dc164e86 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:57.634431 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-10e2d7b8-0e67-41db-ba49-96d0dc164e86 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.161354 Oct 30 00:48:57.634992 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 50/97] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:57 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:58.102485 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5baca373-33d3-4dd8-9174-a610f66e94a2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:58.103085 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5baca373-33d3-4dd8-9174-a610f66e94a2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:58.109779 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5baca373-33d3-4dd8-9174-a610f66e94a2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:58.110254 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5baca373-33d3-4dd8-9174-a610f66e94a2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:58.110677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5baca373-33d3-4dd8-9174-a610f66e94a2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:58.111351 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5baca373-33d3-4dd8-9174-a610f66e94a2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:58.111794 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5baca373-33d3-4dd8-9174-a610f66e94a2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:58.112244 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5baca373-33d3-4dd8-9174-a610f66e94a2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:58.113995 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-5d025123-14f8-4723-b5a8-ad3e3a21f215 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:58.114765 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-5d025123-14f8-4723-b5a8-ad3e3a21f215 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:58.121340 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5d025123-14f8-4723-b5a8-ad3e3a21f215 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:58.122513 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5d025123-14f8-4723-b5a8-ad3e3a21f215 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:58.123292 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5d025123-14f8-4723-b5a8-ad3e3a21f215 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:58.124001 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5d025123-14f8-4723-b5a8-ad3e3a21f215 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:58.124520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5d025123-14f8-4723-b5a8-ad3e3a21f215 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:58.124946 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5d025123-14f8-4723-b5a8-ad3e3a21f215 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:58.307166 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5baca373-33d3-4dd8-9174-a610f66e94a2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:58.315857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5baca373-33d3-4dd8-9174-a610f66e94a2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.217115 Oct 30 00:48:58.318038 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 48/98] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:58 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:48:58.322715 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-5d025123-14f8-4723-b5a8-ad3e3a21f215 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:58.327023 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-fea553f7-152c-4693-8454-3354529f4ddb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:58.327733 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-fea553f7-152c-4693-8454-3354529f4ddb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:58.329796 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-5d025123-14f8-4723-b5a8-ad3e3a21f215 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.219941 Oct 30 00:48:58.333802 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 51/99] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:58 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:48:58.333922 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fea553f7-152c-4693-8454-3354529f4ddb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:58.334445 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fea553f7-152c-4693-8454-3354529f4ddb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:58.334878 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fea553f7-152c-4693-8454-3354529f4ddb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:58.335568 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fea553f7-152c-4693-8454-3354529f4ddb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:58.336017 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fea553f7-152c-4693-8454-3354529f4ddb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:58.336463 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fea553f7-152c-4693-8454-3354529f4ddb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:58.468981 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fea553f7-152c-4693-8454-3354529f4ddb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:58.477020 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fea553f7-152c-4693-8454-3354529f4ddb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:58.478453 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fea553f7-152c-4693-8454-3354529f4ddb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:58.479554 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-fea553f7-152c-4693-8454-3354529f4ddb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.157708 Oct 30 00:48:58.480123 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 49/100] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:58 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:48:58.659240 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2ec77da9-8fcb-43ca-9bf1-f99f869adbd5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:58.659858 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2ec77da9-8fcb-43ca-9bf1-f99f869adbd5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:58.665969 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ec77da9-8fcb-43ca-9bf1-f99f869adbd5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:58.666387 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ec77da9-8fcb-43ca-9bf1-f99f869adbd5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:58.666817 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ec77da9-8fcb-43ca-9bf1-f99f869adbd5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:58.667504 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ec77da9-8fcb-43ca-9bf1-f99f869adbd5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:58.667954 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ec77da9-8fcb-43ca-9bf1-f99f869adbd5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:58.668401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ec77da9-8fcb-43ca-9bf1-f99f869adbd5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:58.801899 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2ec77da9-8fcb-43ca-9bf1-f99f869adbd5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:58.809916 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2ec77da9-8fcb-43ca-9bf1-f99f869adbd5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.154136 Oct 30 00:48:58.810940 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 52/101] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:58 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:59.339332 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e45d3e38-a60d-4e5b-9e0c-5d888e29852d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:59.339928 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-e45d3e38-a60d-4e5b-9e0c-5d888e29852d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:59.346088 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e45d3e38-a60d-4e5b-9e0c-5d888e29852d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:59.346564 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e45d3e38-a60d-4e5b-9e0c-5d888e29852d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:59.348500 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e45d3e38-a60d-4e5b-9e0c-5d888e29852d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:59.348500 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e45d3e38-a60d-4e5b-9e0c-5d888e29852d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:59.348500 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e45d3e38-a60d-4e5b-9e0c-5d888e29852d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:59.348500 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e45d3e38-a60d-4e5b-9e0c-5d888e29852d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:59.353332 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-477cfce7-5d5d-46bf-92b8-91787835d231 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:59.353964 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-477cfce7-5d5d-46bf-92b8-91787835d231 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:59.360465 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-477cfce7-5d5d-46bf-92b8-91787835d231 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:59.360935 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-477cfce7-5d5d-46bf-92b8-91787835d231 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:59.361361 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-477cfce7-5d5d-46bf-92b8-91787835d231 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:59.362036 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-477cfce7-5d5d-46bf-92b8-91787835d231 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:59.362535 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-477cfce7-5d5d-46bf-92b8-91787835d231 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:59.362951 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-477cfce7-5d5d-46bf-92b8-91787835d231 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:59.556129 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-e45d3e38-a60d-4e5b-9e0c-5d888e29852d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:59.560704 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-477cfce7-5d5d-46bf-92b8-91787835d231 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:59.565580 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e45d3e38-a60d-4e5b-9e0c-5d888e29852d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.230019 Oct 30 00:48:59.566368 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 50/102] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:59 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:59.570532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-477cfce7-5d5d-46bf-92b8-91787835d231 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.219704 Oct 30 00:48:59.570532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 53/103] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:59 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:48:59.576698 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f690917e-83a4-4666-915a-bfe017efd6a1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:59.577444 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f690917e-83a4-4666-915a-bfe017efd6a1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:59.584184 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f690917e-83a4-4666-915a-bfe017efd6a1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:59.584647 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f690917e-83a4-4666-915a-bfe017efd6a1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:59.585220 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f690917e-83a4-4666-915a-bfe017efd6a1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:59.585931 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f690917e-83a4-4666-915a-bfe017efd6a1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:59.586376 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f690917e-83a4-4666-915a-bfe017efd6a1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:59.587319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f690917e-83a4-4666-915a-bfe017efd6a1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:59.725713 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f690917e-83a4-4666-915a-bfe017efd6a1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:59.734548 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f690917e-83a4-4666-915a-bfe017efd6a1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:59.736381 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f690917e-83a4-4666-915a-bfe017efd6a1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:59.737528 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f690917e-83a4-4666-915a-bfe017efd6a1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.170064 Oct 30 00:48:59.738091 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 51/104] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:48:59 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:48:59.834301 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-85e69fd2-b3fa-431f-8111-4b7c73660523 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:48:59.834907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-85e69fd2-b3fa-431f-8111-4b7c73660523 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:48:59.841170 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-85e69fd2-b3fa-431f-8111-4b7c73660523 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:59.841816 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-85e69fd2-b3fa-431f-8111-4b7c73660523 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:59.842285 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-85e69fd2-b3fa-431f-8111-4b7c73660523 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:59.843024 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-85e69fd2-b3fa-431f-8111-4b7c73660523 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:48:59.843705 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-85e69fd2-b3fa-431f-8111-4b7c73660523 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:48:59.843964 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-85e69fd2-b3fa-431f-8111-4b7c73660523 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:48:59.974115 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-85e69fd2-b3fa-431f-8111-4b7c73660523 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:48:59.982260 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-85e69fd2-b3fa-431f-8111-4b7c73660523 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.151718 Oct 30 00:48:59.982818 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 54/105] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:48:59 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:00.589568 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-6d777f8f-393b-4928-8b0c-3102b107f34a tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:00.590513 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-6d777f8f-393b-4928-8b0c-3102b107f34a tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:00.594823 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-63d4460c-be64-44e6-aa2e-20ed492808e0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:00.595427 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-63d4460c-be64-44e6-aa2e-20ed492808e0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:00.597194 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6d777f8f-393b-4928-8b0c-3102b107f34a tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:00.597665 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6d777f8f-393b-4928-8b0c-3102b107f34a tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:00.598084 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6d777f8f-393b-4928-8b0c-3102b107f34a tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:00.598759 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6d777f8f-393b-4928-8b0c-3102b107f34a tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:00.599199 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6d777f8f-393b-4928-8b0c-3102b107f34a tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:00.599613 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6d777f8f-393b-4928-8b0c-3102b107f34a tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:00.601601 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-63d4460c-be64-44e6-aa2e-20ed492808e0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:00.602081 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-63d4460c-be64-44e6-aa2e-20ed492808e0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:00.602510 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-63d4460c-be64-44e6-aa2e-20ed492808e0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:00.603200 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-63d4460c-be64-44e6-aa2e-20ed492808e0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:00.603658 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-63d4460c-be64-44e6-aa2e-20ed492808e0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:00.604104 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-63d4460c-be64-44e6-aa2e-20ed492808e0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:00.796157 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-63d4460c-be64-44e6-aa2e-20ed492808e0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:00.802895 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-6d777f8f-393b-4928-8b0c-3102b107f34a tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:00.804153 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-63d4460c-be64-44e6-aa2e-20ed492808e0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.213764 Oct 30 00:49:00.804991 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 55/106] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:00 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:00.810118 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-58052b69-cccd-4753-a15b-fcdb5871e9a5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:00.810611 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-58052b69-cccd-4753-a15b-fcdb5871e9a5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:00.811549 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-6d777f8f-393b-4928-8b0c-3102b107f34a tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.225932 Oct 30 00:49:00.813301 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 52/107] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:00 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:00.816871 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58052b69-cccd-4753-a15b-fcdb5871e9a5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:00.817482 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58052b69-cccd-4753-a15b-fcdb5871e9a5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:00.818092 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58052b69-cccd-4753-a15b-fcdb5871e9a5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:00.818888 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58052b69-cccd-4753-a15b-fcdb5871e9a5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:00.819437 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58052b69-cccd-4753-a15b-fcdb5871e9a5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:00.819968 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58052b69-cccd-4753-a15b-fcdb5871e9a5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:00.952486 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-58052b69-cccd-4753-a15b-fcdb5871e9a5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:00.960804 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-58052b69-cccd-4753-a15b-fcdb5871e9a5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:00.962282 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-58052b69-cccd-4753-a15b-fcdb5871e9a5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:00.963470 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-58052b69-cccd-4753-a15b-fcdb5871e9a5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.157746 Oct 30 00:49:00.964033 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 56/108] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:00 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:49:01.006420 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-368dcf00-159f-466d-97a1-8172f22ed124 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:01.007022 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-368dcf00-159f-466d-97a1-8172f22ed124 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:01.013563 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-368dcf00-159f-466d-97a1-8172f22ed124 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:01.014030 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-368dcf00-159f-466d-97a1-8172f22ed124 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:01.014461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-368dcf00-159f-466d-97a1-8172f22ed124 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:01.015139 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-368dcf00-159f-466d-97a1-8172f22ed124 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:01.015583 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-368dcf00-159f-466d-97a1-8172f22ed124 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:01.015998 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-368dcf00-159f-466d-97a1-8172f22ed124 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:01.152273 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-368dcf00-159f-466d-97a1-8172f22ed124 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:01.158913 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-368dcf00-159f-466d-97a1-8172f22ed124 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.156344 Oct 30 00:49:01.159580 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 53/109] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:01 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:01.827935 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-a3fa1051-0a40-4460-9299-29d28750f5b3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:01.828563 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-a3fa1051-0a40-4460-9299-29d28750f5b3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:01.834640 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a3fa1051-0a40-4460-9299-29d28750f5b3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:01.835115 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a3fa1051-0a40-4460-9299-29d28750f5b3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:01.835540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a3fa1051-0a40-4460-9299-29d28750f5b3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:01.835754 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5a777669-acef-4ef1-82c0-b07906031b95 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:01.836241 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a3fa1051-0a40-4460-9299-29d28750f5b3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:01.836393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5a777669-acef-4ef1-82c0-b07906031b95 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:01.836677 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a3fa1051-0a40-4460-9299-29d28750f5b3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:01.837090 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a3fa1051-0a40-4460-9299-29d28750f5b3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:01.842999 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a777669-acef-4ef1-82c0-b07906031b95 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:01.843497 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a777669-acef-4ef1-82c0-b07906031b95 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:01.843930 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a777669-acef-4ef1-82c0-b07906031b95 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:01.844660 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a777669-acef-4ef1-82c0-b07906031b95 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:01.845112 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a777669-acef-4ef1-82c0-b07906031b95 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:01.845534 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a777669-acef-4ef1-82c0-b07906031b95 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:02.050603 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-a3fa1051-0a40-4460-9299-29d28750f5b3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:02.061239 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-a3fa1051-0a40-4460-9299-29d28750f5b3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.236887 Oct 30 00:49:02.062439 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 57/110] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:01 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:02.067514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f5d2981b-94bc-41c0-a061-dbefbe8665db tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:02.068131 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-f5d2981b-94bc-41c0-a061-dbefbe8665db tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:02.073950 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f5d2981b-94bc-41c0-a061-dbefbe8665db tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:02.074425 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f5d2981b-94bc-41c0-a061-dbefbe8665db tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:02.074904 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f5d2981b-94bc-41c0-a061-dbefbe8665db tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:02.076289 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f5d2981b-94bc-41c0-a061-dbefbe8665db tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:02.076742 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f5d2981b-94bc-41c0-a061-dbefbe8665db tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:02.077162 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f5d2981b-94bc-41c0-a061-dbefbe8665db tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:02.092913 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5a777669-acef-4ef1-82c0-b07906031b95 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:02.119212 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5a777669-acef-4ef1-82c0-b07906031b95 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.287169 Oct 30 00:49:02.119777 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 54/111] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:01 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:02.187355 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-95fb2328-ecd9-4612-89c5-b35b2bccabd6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:02.187969 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-95fb2328-ecd9-4612-89c5-b35b2bccabd6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:02.196262 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-95fb2328-ecd9-4612-89c5-b35b2bccabd6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:02.200680 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-95fb2328-ecd9-4612-89c5-b35b2bccabd6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:02.204933 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-95fb2328-ecd9-4612-89c5-b35b2bccabd6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:02.205925 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-95fb2328-ecd9-4612-89c5-b35b2bccabd6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:02.206532 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-95fb2328-ecd9-4612-89c5-b35b2bccabd6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:02.207111 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-95fb2328-ecd9-4612-89c5-b35b2bccabd6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:02.578951 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-f5d2981b-94bc-41c0-a061-dbefbe8665db tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:02.587581 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-f5d2981b-94bc-41c0-a061-dbefbe8665db tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:02.589317 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-f5d2981b-94bc-41c0-a061-dbefbe8665db tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:02.592844 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-f5d2981b-94bc-41c0-a061-dbefbe8665db tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.527438 Oct 30 00:49:02.603006 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-95fb2328-ecd9-4612-89c5-b35b2bccabd6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:02.607310 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 58/112] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:02 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:49:02.613162 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-95fb2328-ecd9-4612-89c5-b35b2bccabd6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.429561 Oct 30 00:49:02.613895 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 55/113] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:02 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:03.085605 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-151fd7a5-1bf2-4024-9d0b-3eeecdea84cb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:03.086191 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-151fd7a5-1bf2-4024-9d0b-3eeecdea84cb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:03.093180 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-151fd7a5-1bf2-4024-9d0b-3eeecdea84cb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:03.093661 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-151fd7a5-1bf2-4024-9d0b-3eeecdea84cb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:03.094089 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-151fd7a5-1bf2-4024-9d0b-3eeecdea84cb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:03.094780 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-151fd7a5-1bf2-4024-9d0b-3eeecdea84cb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:03.095229 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-151fd7a5-1bf2-4024-9d0b-3eeecdea84cb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:03.095644 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-151fd7a5-1bf2-4024-9d0b-3eeecdea84cb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:03.146854 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f6160848-be7a-47b9-96d7-d996c01797c9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:03.147882 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f6160848-be7a-47b9-96d7-d996c01797c9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:03.154531 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6160848-be7a-47b9-96d7-d996c01797c9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:03.155007 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6160848-be7a-47b9-96d7-d996c01797c9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:03.155433 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6160848-be7a-47b9-96d7-d996c01797c9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:03.156176 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6160848-be7a-47b9-96d7-d996c01797c9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:03.156629 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6160848-be7a-47b9-96d7-d996c01797c9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:03.157048 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6160848-be7a-47b9-96d7-d996c01797c9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:03.427468 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-151fd7a5-1bf2-4024-9d0b-3eeecdea84cb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:03.435538 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-151fd7a5-1bf2-4024-9d0b-3eeecdea84cb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.353646 Oct 30 00:49:03.436114 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 59/114] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:03 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:03.464009 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f6160848-be7a-47b9-96d7-d996c01797c9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:03.472231 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f6160848-be7a-47b9-96d7-d996c01797c9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.329202 Oct 30 00:49:03.472789 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 56/115] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:03 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:03.619275 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-8100af6a-35c8-4eed-98ab-386cb3590cba tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:03.619858 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-8100af6a-35c8-4eed-98ab-386cb3590cba tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:03.626979 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8100af6a-35c8-4eed-98ab-386cb3590cba tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:03.627469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8100af6a-35c8-4eed-98ab-386cb3590cba tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:03.627898 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8100af6a-35c8-4eed-98ab-386cb3590cba tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:03.628623 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8100af6a-35c8-4eed-98ab-386cb3590cba tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:03.629068 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8100af6a-35c8-4eed-98ab-386cb3590cba tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:03.629482 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8100af6a-35c8-4eed-98ab-386cb3590cba tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:03.638665 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-fc91495d-0355-4327-a62e-da0785813cb8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:03.639307 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-fc91495d-0355-4327-a62e-da0785813cb8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:03.645232 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fc91495d-0355-4327-a62e-da0785813cb8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:03.645714 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fc91495d-0355-4327-a62e-da0785813cb8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:03.646148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fc91495d-0355-4327-a62e-da0785813cb8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:03.646833 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fc91495d-0355-4327-a62e-da0785813cb8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:03.647290 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fc91495d-0355-4327-a62e-da0785813cb8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:03.647710 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fc91495d-0355-4327-a62e-da0785813cb8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:03.820531 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-8100af6a-35c8-4eed-98ab-386cb3590cba tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:03.830123 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-8100af6a-35c8-4eed-98ab-386cb3590cba tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:03.831678 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-8100af6a-35c8-4eed-98ab-386cb3590cba tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:03.832971 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-8100af6a-35c8-4eed-98ab-386cb3590cba tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.217777 Oct 30 00:49:03.833689 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 60/116] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:03 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:49:03.843918 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fc91495d-0355-4327-a62e-da0785813cb8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:03.855215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-fc91495d-0355-4327-a62e-da0785813cb8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.221314 Oct 30 00:49:03.855775 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 57/117] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:03 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:04.458766 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-30503b90-97e7-4f21-bdcf-4cb8911387ae tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:04.459496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-30503b90-97e7-4f21-bdcf-4cb8911387ae tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:04.465469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30503b90-97e7-4f21-bdcf-4cb8911387ae tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:04.465933 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30503b90-97e7-4f21-bdcf-4cb8911387ae tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:04.466431 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30503b90-97e7-4f21-bdcf-4cb8911387ae tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:04.467632 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30503b90-97e7-4f21-bdcf-4cb8911387ae tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:04.468146 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30503b90-97e7-4f21-bdcf-4cb8911387ae tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:04.468562 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30503b90-97e7-4f21-bdcf-4cb8911387ae tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:04.495462 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1a6a9d34-07e2-4a99-a318-f92bf8d6dffd tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:04.496057 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1a6a9d34-07e2-4a99-a318-f92bf8d6dffd tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:04.503348 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a6a9d34-07e2-4a99-a318-f92bf8d6dffd tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:04.503851 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a6a9d34-07e2-4a99-a318-f92bf8d6dffd tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:04.504308 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a6a9d34-07e2-4a99-a318-f92bf8d6dffd tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:04.504998 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a6a9d34-07e2-4a99-a318-f92bf8d6dffd tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:04.505439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a6a9d34-07e2-4a99-a318-f92bf8d6dffd tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:04.505851 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a6a9d34-07e2-4a99-a318-f92bf8d6dffd tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:04.655950 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-30503b90-97e7-4f21-bdcf-4cb8911387ae tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:04.663699 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-30503b90-97e7-4f21-bdcf-4cb8911387ae tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.209080 Oct 30 00:49:04.664292 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 61/118] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:04 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:04.684526 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1a6a9d34-07e2-4a99-a318-f92bf8d6dffd tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:04.692540 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1a6a9d34-07e2-4a99-a318-f92bf8d6dffd tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.200878 Oct 30 00:49:04.693103 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 58/119] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:04 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:04.860395 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-66b0caf6-2f4d-4a90-99b1-07a799b8e77e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:04.860912 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-66b0caf6-2f4d-4a90-99b1-07a799b8e77e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:04.867377 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-66b0caf6-2f4d-4a90-99b1-07a799b8e77e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:04.867898 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-66b0caf6-2f4d-4a90-99b1-07a799b8e77e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:04.868821 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-66b0caf6-2f4d-4a90-99b1-07a799b8e77e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:04.869790 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-66b0caf6-2f4d-4a90-99b1-07a799b8e77e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:04.870120 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-66b0caf6-2f4d-4a90-99b1-07a799b8e77e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:04.870542 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-66b0caf6-2f4d-4a90-99b1-07a799b8e77e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:04.878783 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e2667cee-2c3a-414c-9527-47ffe72a5548 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:04.878889 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-e2667cee-2c3a-414c-9527-47ffe72a5548 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:04.887130 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e2667cee-2c3a-414c-9527-47ffe72a5548 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:04.887605 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e2667cee-2c3a-414c-9527-47ffe72a5548 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:04.888030 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e2667cee-2c3a-414c-9527-47ffe72a5548 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:04.889952 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e2667cee-2c3a-414c-9527-47ffe72a5548 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:04.890402 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e2667cee-2c3a-414c-9527-47ffe72a5548 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:04.890822 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e2667cee-2c3a-414c-9527-47ffe72a5548 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:05.084370 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-e2667cee-2c3a-414c-9527-47ffe72a5548 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:05.090501 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-66b0caf6-2f4d-4a90-99b1-07a799b8e77e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:05.093613 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e2667cee-2c3a-414c-9527-47ffe72a5548 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.218970 Oct 30 00:49:05.094177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 59/120] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:04 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:05.099821 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-66b0caf6-2f4d-4a90-99b1-07a799b8e77e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:05.101298 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-66b0caf6-2f4d-4a90-99b1-07a799b8e77e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:05.102378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-66b0caf6-2f4d-4a90-99b1-07a799b8e77e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.247151 Oct 30 00:49:05.102910 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 62/121] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:04 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:49:05.688151 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-63da58a1-3675-4662-88be-84f68e7e64d0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:05.688682 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-63da58a1-3675-4662-88be-84f68e7e64d0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:05.694906 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-63da58a1-3675-4662-88be-84f68e7e64d0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:05.695384 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-63da58a1-3675-4662-88be-84f68e7e64d0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:05.695813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-63da58a1-3675-4662-88be-84f68e7e64d0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:05.696529 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-63da58a1-3675-4662-88be-84f68e7e64d0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:05.696976 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-63da58a1-3675-4662-88be-84f68e7e64d0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:05.697401 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-63da58a1-3675-4662-88be-84f68e7e64d0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:05.714573 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7cc45d4f-8a65-427f-83c0-db02c1a8e1ad tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:05.715175 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-7cc45d4f-8a65-427f-83c0-db02c1a8e1ad tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:05.721618 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7cc45d4f-8a65-427f-83c0-db02c1a8e1ad tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:05.722104 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7cc45d4f-8a65-427f-83c0-db02c1a8e1ad tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:05.722520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7cc45d4f-8a65-427f-83c0-db02c1a8e1ad tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:05.723199 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7cc45d4f-8a65-427f-83c0-db02c1a8e1ad tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:05.723644 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7cc45d4f-8a65-427f-83c0-db02c1a8e1ad tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:05.724055 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7cc45d4f-8a65-427f-83c0-db02c1a8e1ad tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:05.894890 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-63da58a1-3675-4662-88be-84f68e7e64d0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:05.902015 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7cc45d4f-8a65-427f-83c0-db02c1a8e1ad tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:05.902598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-63da58a1-3675-4662-88be-84f68e7e64d0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.219511 Oct 30 00:49:05.903169 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 60/122] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:05 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:05.910878 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7cc45d4f-8a65-427f-83c0-db02c1a8e1ad tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.199876 Oct 30 00:49:05.911642 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 63/123] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:05 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:06.116931 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-056b1fd9-f1d7-4fb4-a38c-9724ad2893a5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:06.117650 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-056b1fd9-f1d7-4fb4-a38c-9724ad2893a5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:06.124950 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-056b1fd9-f1d7-4fb4-a38c-9724ad2893a5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:06.125440 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-056b1fd9-f1d7-4fb4-a38c-9724ad2893a5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:06.125915 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-056b1fd9-f1d7-4fb4-a38c-9724ad2893a5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:06.126643 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-056b1fd9-f1d7-4fb4-a38c-9724ad2893a5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:06.127095 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-056b1fd9-f1d7-4fb4-a38c-9724ad2893a5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:06.127311 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-80f78ef4-78bc-4f26-837c-bf15b766798c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:06.127515 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-056b1fd9-f1d7-4fb4-a38c-9724ad2893a5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:06.128077 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-80f78ef4-78bc-4f26-837c-bf15b766798c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:06.129908 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:06.136293 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-80f78ef4-78bc-4f26-837c-bf15b766798c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:06.136804 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-80f78ef4-78bc-4f26-837c-bf15b766798c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:06.137226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-80f78ef4-78bc-4f26-837c-bf15b766798c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:06.137911 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-80f78ef4-78bc-4f26-837c-bf15b766798c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:06.138931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-80f78ef4-78bc-4f26-837c-bf15b766798c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:06.139351 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-80f78ef4-78bc-4f26-837c-bf15b766798c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:06.334838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-056b1fd9-f1d7-4fb4-a38c-9724ad2893a5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:06.339096 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-80f78ef4-78bc-4f26-837c-bf15b766798c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:06.343094 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-056b1fd9-f1d7-4fb4-a38c-9724ad2893a5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.230307 Oct 30 00:49:06.343818 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 61/124] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:06 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:06.349777 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-80f78ef4-78bc-4f26-837c-bf15b766798c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:06.351283 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-80f78ef4-78bc-4f26-837c-bf15b766798c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:06.352522 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-80f78ef4-78bc-4f26-837c-bf15b766798c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.229713 Oct 30 00:49:06.353233 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 64/125] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:06 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:06.927140 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5828b1f3-ec43-49a2-ba20-c86f13b5a92a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:06.927747 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5828b1f3-ec43-49a2-ba20-c86f13b5a92a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:06.933888 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5828b1f3-ec43-49a2-ba20-c86f13b5a92a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:06.934485 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b356b182-1a71-4ffe-ad3f-8756488be994 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:06.934946 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5828b1f3-ec43-49a2-ba20-c86f13b5a92a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:06.935105 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5828b1f3-ec43-49a2-ba20-c86f13b5a92a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:06.935249 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-b356b182-1a71-4ffe-ad3f-8756488be994 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:06.935651 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5828b1f3-ec43-49a2-ba20-c86f13b5a92a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:06.936219 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5828b1f3-ec43-49a2-ba20-c86f13b5a92a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:06.936645 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5828b1f3-ec43-49a2-ba20-c86f13b5a92a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:06.940906 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=100 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:06.941365 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b356b182-1a71-4ffe-ad3f-8756488be994 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:06.941925 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b356b182-1a71-4ffe-ad3f-8756488be994 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:06.942423 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b356b182-1a71-4ffe-ad3f-8756488be994 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:06.943281 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b356b182-1a71-4ffe-ad3f-8756488be994 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:06.943737 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b356b182-1a71-4ffe-ad3f-8756488be994 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:06.944284 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b356b182-1a71-4ffe-ad3f-8756488be994 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:07.137327 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5828b1f3-ec43-49a2-ba20-c86f13b5a92a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:07.140877 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b356b182-1a71-4ffe-ad3f-8756488be994 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:07.147750 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=100 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:07.149297 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b356b182-1a71-4ffe-ad3f-8756488be994 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.218807 Oct 30 00:49:07.149859 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 65/126] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:06 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:07.150712 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5828b1f3-ec43-49a2-ba20-c86f13b5a92a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.227167 Oct 30 00:49:07.151276 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 62/127] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:06 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:07.365548 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-19ac6e93-a16a-41cf-b729-e90a263cd29f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:07.366096 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-19ac6e93-a16a-41cf-b729-e90a263cd29f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:07.371998 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-19ac6e93-a16a-41cf-b729-e90a263cd29f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:07.372568 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-19ac6e93-a16a-41cf-b729-e90a263cd29f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:07.373153 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-19ac6e93-a16a-41cf-b729-e90a263cd29f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:07.373838 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-19ac6e93-a16a-41cf-b729-e90a263cd29f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:07.374286 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-19ac6e93-a16a-41cf-b729-e90a263cd29f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:07.374701 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-19ac6e93-a16a-41cf-b729-e90a263cd29f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:07.377920 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-6df07758-1262-4667-a1c1-3268e4046763 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:07.378515 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-6df07758-1262-4667-a1c1-3268e4046763 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:07.384550 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6df07758-1262-4667-a1c1-3268e4046763 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:07.385019 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6df07758-1262-4667-a1c1-3268e4046763 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:07.385441 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6df07758-1262-4667-a1c1-3268e4046763 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:07.386111 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6df07758-1262-4667-a1c1-3268e4046763 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:07.386550 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6df07758-1262-4667-a1c1-3268e4046763 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:07.386961 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6df07758-1262-4667-a1c1-3268e4046763 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:07.580962 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-19ac6e93-a16a-41cf-b729-e90a263cd29f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:07.587931 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-6df07758-1262-4667-a1c1-3268e4046763 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:07.588619 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-19ac6e93-a16a-41cf-b729-e90a263cd29f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.227114 Oct 30 00:49:07.589189 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 66/128] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:07 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:07.597233 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-6df07758-1262-4667-a1c1-3268e4046763 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:07.598676 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-6df07758-1262-4667-a1c1-3268e4046763 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:07.599793 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-6df07758-1262-4667-a1c1-3268e4046763 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.225694 Oct 30 00:49:07.600417 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 63/129] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:07 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:49:08.172970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-a5db2348-84cb-4282-869b-37d0fa44f27c tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:08.173570 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-a5db2348-84cb-4282-869b-37d0fa44f27c tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:08.174289 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-9eb8814b-9ffd-4bbf-a401-7d4ee84ab88c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:08.174897 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-9eb8814b-9ffd-4bbf-a401-7d4ee84ab88c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:08.180300 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a5db2348-84cb-4282-869b-37d0fa44f27c tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:08.180776 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a5db2348-84cb-4282-869b-37d0fa44f27c tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:08.180896 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9eb8814b-9ffd-4bbf-a401-7d4ee84ab88c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:08.181198 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a5db2348-84cb-4282-869b-37d0fa44f27c tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:08.181318 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9eb8814b-9ffd-4bbf-a401-7d4ee84ab88c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:08.181751 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9eb8814b-9ffd-4bbf-a401-7d4ee84ab88c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:08.181888 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a5db2348-84cb-4282-869b-37d0fa44f27c tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:08.182310 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a5db2348-84cb-4282-869b-37d0fa44f27c tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:08.182716 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9eb8814b-9ffd-4bbf-a401-7d4ee84ab88c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:08.182827 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a5db2348-84cb-4282-869b-37d0fa44f27c tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:08.183171 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9eb8814b-9ffd-4bbf-a401-7d4ee84ab88c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:08.183619 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9eb8814b-9ffd-4bbf-a401-7d4ee84ab88c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:08.382800 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-9eb8814b-9ffd-4bbf-a401-7d4ee84ab88c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:08.386930 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-a5db2348-84cb-4282-869b-37d0fa44f27c tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:08.390906 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-9eb8814b-9ffd-4bbf-a401-7d4ee84ab88c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.220731 Oct 30 00:49:08.391481 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 64/130] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:08 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:08.395666 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-a5db2348-84cb-4282-869b-37d0fa44f27c tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.227205 Oct 30 00:49:08.396251 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 67/131] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:08 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:08.612471 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-ffb44911-b020-4072-9206-93e8f48d2453 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:08.613228 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-ffb44911-b020-4072-9206-93e8f48d2453 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:08.619600 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ffb44911-b020-4072-9206-93e8f48d2453 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:08.620189 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ffb44911-b020-4072-9206-93e8f48d2453 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:08.620539 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ffb44911-b020-4072-9206-93e8f48d2453 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:08.621227 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ffb44911-b020-4072-9206-93e8f48d2453 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:08.621676 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ffb44911-b020-4072-9206-93e8f48d2453 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:08.622093 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ffb44911-b020-4072-9206-93e8f48d2453 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:08.625099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b0dec0e4-7e93-4a45-be77-52fa53657e42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:08.625471 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-b0dec0e4-7e93-4a45-be77-52fa53657e42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:08.631280 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b0dec0e4-7e93-4a45-be77-52fa53657e42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:08.631759 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b0dec0e4-7e93-4a45-be77-52fa53657e42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:08.632220 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b0dec0e4-7e93-4a45-be77-52fa53657e42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:08.632906 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b0dec0e4-7e93-4a45-be77-52fa53657e42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:08.633352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b0dec0e4-7e93-4a45-be77-52fa53657e42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:08.633770 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b0dec0e4-7e93-4a45-be77-52fa53657e42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:08.817929 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ffb44911-b020-4072-9206-93e8f48d2453 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:08.822040 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b0dec0e4-7e93-4a45-be77-52fa53657e42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:08.825498 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-ffb44911-b020-4072-9206-93e8f48d2453 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.217408 Oct 30 00:49:08.826054 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 65/132] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:08 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:08.830415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b0dec0e4-7e93-4a45-be77-52fa53657e42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:08.831871 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b0dec0e4-7e93-4a45-be77-52fa53657e42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:08.833003 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b0dec0e4-7e93-4a45-be77-52fa53657e42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.213140 Oct 30 00:49:08.833575 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 68/133] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:08 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:09.413200 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-213946b0-3c4f-4182-8a25-5ac18dab207c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:09.414544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-213946b0-3c4f-4182-8a25-5ac18dab207c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:09.419957 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4eabacdc-36f9-44eb-954a-71fab93ee804 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:09.421991 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-4eabacdc-36f9-44eb-954a-71fab93ee804 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:09.428948 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4eabacdc-36f9-44eb-954a-71fab93ee804 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:09.429753 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-213946b0-3c4f-4182-8a25-5ac18dab207c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:09.429753 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-213946b0-3c4f-4182-8a25-5ac18dab207c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:09.430024 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4eabacdc-36f9-44eb-954a-71fab93ee804 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:09.430173 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-213946b0-3c4f-4182-8a25-5ac18dab207c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:09.430777 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4eabacdc-36f9-44eb-954a-71fab93ee804 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:09.430882 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-213946b0-3c4f-4182-8a25-5ac18dab207c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:09.431299 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-213946b0-3c4f-4182-8a25-5ac18dab207c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:09.431884 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-213946b0-3c4f-4182-8a25-5ac18dab207c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:09.432348 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4eabacdc-36f9-44eb-954a-71fab93ee804 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:09.432970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4eabacdc-36f9-44eb-954a-71fab93ee804 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:09.433592 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4eabacdc-36f9-44eb-954a-71fab93ee804 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:09.741935 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-213946b0-3c4f-4182-8a25-5ac18dab207c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:09.746726 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4eabacdc-36f9-44eb-954a-71fab93ee804 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:09.752842 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-213946b0-3c4f-4182-8a25-5ac18dab207c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.343512 Oct 30 00:49:09.754235 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 66/134] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:09 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:09.755617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-4eabacdc-36f9-44eb-954a-71fab93ee804 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.340537 Oct 30 00:49:09.756202 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 69/135] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:09 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:09.823095 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-1b45739e-f6a9-46c7-8a3b-17ddc449ac8c req-41452dda-cad7-4e40-b53e-7938696a623f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00747eb3-1c2b-40b2-8e0a-9c440529e833", "name": "network-vif-plugged", "status": "completed", "tag": "0b7471a7-8df2-4f56-8dad-8f89610685f3"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:49:09.832544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-1b45739e-f6a9-46c7-8a3b-17ddc449ac8c req-41452dda-cad7-4e40-b53e-7938696a623f service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:09.833011 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-1b45739e-f6a9-46c7-8a3b-17ddc449ac8c req-41452dda-cad7-4e40-b53e-7938696a623f service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:09.833431 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-1b45739e-f6a9-46c7-8a3b-17ddc449ac8c req-41452dda-cad7-4e40-b53e-7938696a623f service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:09.845089 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-1b45739e-f6a9-46c7-8a3b-17ddc449ac8c req-41452dda-cad7-4e40-b53e-7938696a623f service nova] Creating event network-vif-plugged:0b7471a7-8df2-4f56-8dad-8f89610685f3 for instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 on hv-cinder-86149 Oct 30 00:49:09.848302 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-34c8e102-7e99-4e73-b98f-f57f4cd284a1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:09.848914 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-34c8e102-7e99-4e73-b98f-f57f4cd284a1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:09.850055 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-1b45739e-f6a9-46c7-8a3b-17ddc449ac8c req-41452dda-cad7-4e40-b53e-7938696a623f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079846 Oct 30 00:49:09.850638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 67/136] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:49:09.855192 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-34c8e102-7e99-4e73-b98f-f57f4cd284a1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:09.855677 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-34c8e102-7e99-4e73-b98f-f57f4cd284a1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:09.856131 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-34c8e102-7e99-4e73-b98f-f57f4cd284a1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:09.856824 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-34c8e102-7e99-4e73-b98f-f57f4cd284a1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:09.857283 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-34c8e102-7e99-4e73-b98f-f57f4cd284a1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:09.857703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-34c8e102-7e99-4e73-b98f-f57f4cd284a1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:09.857994 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-165f6398-b23a-443a-8ca5-3874f82fb43e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:09.859430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-165f6398-b23a-443a-8ca5-3874f82fb43e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:09.865833 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-165f6398-b23a-443a-8ca5-3874f82fb43e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:09.866315 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-165f6398-b23a-443a-8ca5-3874f82fb43e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:09.866744 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-165f6398-b23a-443a-8ca5-3874f82fb43e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:09.867427 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-165f6398-b23a-443a-8ca5-3874f82fb43e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:09.867871 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-165f6398-b23a-443a-8ca5-3874f82fb43e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:09.868348 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-165f6398-b23a-443a-8ca5-3874f82fb43e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:10.053151 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-34c8e102-7e99-4e73-b98f-f57f4cd284a1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:10.059965 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-165f6398-b23a-443a-8ca5-3874f82fb43e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:10.064800 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-34c8e102-7e99-4e73-b98f-f57f4cd284a1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.220312 Oct 30 00:49:10.065497 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 70/137] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:09 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:10.069042 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-165f6398-b23a-443a-8ca5-3874f82fb43e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:10.070436 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-165f6398-b23a-443a-8ca5-3874f82fb43e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:10.071523 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-165f6398-b23a-443a-8ca5-3874f82fb43e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.217566 Oct 30 00:49:10.072054 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 68/138] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:09 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:10.777182 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c178d303-aa37-42f2-b9b9-4fc3de4c0e49 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:10.777739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-b7ab17a4-5bfa-4539-bef3-194536f6bda5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:10.778119 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c178d303-aa37-42f2-b9b9-4fc3de4c0e49 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:10.778336 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-b7ab17a4-5bfa-4539-bef3-194536f6bda5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:10.784401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c178d303-aa37-42f2-b9b9-4fc3de4c0e49 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:10.784957 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c178d303-aa37-42f2-b9b9-4fc3de4c0e49 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:10.785052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b7ab17a4-5bfa-4539-bef3-194536f6bda5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:10.785489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b7ab17a4-5bfa-4539-bef3-194536f6bda5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:10.785594 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c178d303-aa37-42f2-b9b9-4fc3de4c0e49 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:10.785915 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b7ab17a4-5bfa-4539-bef3-194536f6bda5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:10.786525 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c178d303-aa37-42f2-b9b9-4fc3de4c0e49 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:10.786655 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b7ab17a4-5bfa-4539-bef3-194536f6bda5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:10.787003 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b7ab17a4-5bfa-4539-bef3-194536f6bda5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:10.787116 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c178d303-aa37-42f2-b9b9-4fc3de4c0e49 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:10.787417 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b7ab17a4-5bfa-4539-bef3-194536f6bda5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:10.787679 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c178d303-aa37-42f2-b9b9-4fc3de4c0e49 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:10.980041 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-b7ab17a4-5bfa-4539-bef3-194536f6bda5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:10.984711 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c178d303-aa37-42f2-b9b9-4fc3de4c0e49 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:10.988875 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-b7ab17a4-5bfa-4539-bef3-194536f6bda5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.214836 Oct 30 00:49:10.989435 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 69/139] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:10 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:10.992474 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c178d303-aa37-42f2-b9b9-4fc3de4c0e49 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.219207 Oct 30 00:49:10.993023 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 71/140] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:10 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:11.087582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-ea2f749b-d2da-4b62-9648-604dc127ef88 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:11.088294 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-ea2f749b-d2da-4b62-9648-604dc127ef88 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:11.094789 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea2f749b-d2da-4b62-9648-604dc127ef88 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:11.095267 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea2f749b-d2da-4b62-9648-604dc127ef88 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:11.095700 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea2f749b-d2da-4b62-9648-604dc127ef88 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:11.096427 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea2f749b-d2da-4b62-9648-604dc127ef88 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:11.096878 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea2f749b-d2da-4b62-9648-604dc127ef88 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:11.096973 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7e99f074-6ee8-47b9-8959-0c04f1bc730b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:11.097297 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea2f749b-d2da-4b62-9648-604dc127ef88 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:11.097718 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-7e99f074-6ee8-47b9-8959-0c04f1bc730b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:11.103573 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7e99f074-6ee8-47b9-8959-0c04f1bc730b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:11.104042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7e99f074-6ee8-47b9-8959-0c04f1bc730b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:11.104499 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7e99f074-6ee8-47b9-8959-0c04f1bc730b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:11.105170 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7e99f074-6ee8-47b9-8959-0c04f1bc730b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:11.105615 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7e99f074-6ee8-47b9-8959-0c04f1bc730b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:11.106026 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7e99f074-6ee8-47b9-8959-0c04f1bc730b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:11.283597 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ea2f749b-d2da-4b62-9648-604dc127ef88 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:11.289777 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7e99f074-6ee8-47b9-8959-0c04f1bc730b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:11.291433 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-ea2f749b-d2da-4b62-9648-604dc127ef88 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.207557 Oct 30 00:49:11.292038 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 70/141] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:11 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:11.298793 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7e99f074-6ee8-47b9-8959-0c04f1bc730b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:11.300224 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7e99f074-6ee8-47b9-8959-0c04f1bc730b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:11.301308 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7e99f074-6ee8-47b9-8959-0c04f1bc730b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.208584 Oct 30 00:49:11.301847 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 72/142] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:11 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:12.011715 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a3a797df-e714-4bbc-bd29-52fb37c6baad tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:12.012346 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a3a797df-e714-4bbc-bd29-52fb37c6baad tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:12.014984 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c1c1cd0e-9d93-4f5b-8e28-47a574e42778 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:12.015722 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c1c1cd0e-9d93-4f5b-8e28-47a574e42778 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:12.019004 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a3a797df-e714-4bbc-bd29-52fb37c6baad tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:12.019482 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a3a797df-e714-4bbc-bd29-52fb37c6baad tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:12.019911 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a3a797df-e714-4bbc-bd29-52fb37c6baad tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:12.020622 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a3a797df-e714-4bbc-bd29-52fb37c6baad tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:12.021072 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a3a797df-e714-4bbc-bd29-52fb37c6baad tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:12.021488 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a3a797df-e714-4bbc-bd29-52fb37c6baad tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:12.021740 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c1c1cd0e-9d93-4f5b-8e28-47a574e42778 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:12.022196 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c1c1cd0e-9d93-4f5b-8e28-47a574e42778 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:12.022620 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c1c1cd0e-9d93-4f5b-8e28-47a574e42778 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:12.023293 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c1c1cd0e-9d93-4f5b-8e28-47a574e42778 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:12.023735 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c1c1cd0e-9d93-4f5b-8e28-47a574e42778 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:12.024178 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c1c1cd0e-9d93-4f5b-8e28-47a574e42778 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:12.216363 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a3a797df-e714-4bbc-bd29-52fb37c6baad tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:12.220240 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c1c1cd0e-9d93-4f5b-8e28-47a574e42778 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:12.226076 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a3a797df-e714-4bbc-bd29-52fb37c6baad tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.218015 Oct 30 00:49:12.226647 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 71/143] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:12 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:12.228034 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c1c1cd0e-9d93-4f5b-8e28-47a574e42778 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.217401 Oct 30 00:49:12.228634 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 73/144] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:12 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:12.315576 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-dc0106a5-0f49-4a08-b4df-369eb4f2d670 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:12.316200 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-dc0106a5-0f49-4a08-b4df-369eb4f2d670 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:12.322135 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-dc0106a5-0f49-4a08-b4df-369eb4f2d670 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:12.322725 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-dc0106a5-0f49-4a08-b4df-369eb4f2d670 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:12.323289 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-dc0106a5-0f49-4a08-b4df-369eb4f2d670 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:12.324052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-dc0106a5-0f49-4a08-b4df-369eb4f2d670 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:12.324599 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-dc0106a5-0f49-4a08-b4df-369eb4f2d670 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:12.325014 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-dc0106a5-0f49-4a08-b4df-369eb4f2d670 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:12.327103 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-9b9ccf2f-53ee-4307-87a5-8dd7b02f9f0a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:12.327708 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-9b9ccf2f-53ee-4307-87a5-8dd7b02f9f0a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:12.336444 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9b9ccf2f-53ee-4307-87a5-8dd7b02f9f0a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:12.336922 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9b9ccf2f-53ee-4307-87a5-8dd7b02f9f0a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:12.337346 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9b9ccf2f-53ee-4307-87a5-8dd7b02f9f0a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:12.338025 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9b9ccf2f-53ee-4307-87a5-8dd7b02f9f0a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:12.338468 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9b9ccf2f-53ee-4307-87a5-8dd7b02f9f0a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:12.338880 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9b9ccf2f-53ee-4307-87a5-8dd7b02f9f0a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:12.520264 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-dc0106a5-0f49-4a08-b4df-369eb4f2d670 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:12.527137 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9b9ccf2f-53ee-4307-87a5-8dd7b02f9f0a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:12.527806 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-dc0106a5-0f49-4a08-b4df-369eb4f2d670 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.217221 Oct 30 00:49:12.528449 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 72/145] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:12 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:12.536563 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9b9ccf2f-53ee-4307-87a5-8dd7b02f9f0a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:12.538025 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9b9ccf2f-53ee-4307-87a5-8dd7b02f9f0a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:12.539122 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-9b9ccf2f-53ee-4307-87a5-8dd7b02f9f0a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.216219 Oct 30 00:49:12.539697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 74/146] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:12 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:49:13.248382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5eb8f78c-1034-4987-aead-d3e1aea3eb46 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:13.249114 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5eb8f78c-1034-4987-aead-d3e1aea3eb46 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:13.251155 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-39eb255c-92b3-4b1d-8872-35443f5d0024 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:13.251760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-39eb255c-92b3-4b1d-8872-35443f5d0024 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:13.255661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5eb8f78c-1034-4987-aead-d3e1aea3eb46 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:13.256273 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5eb8f78c-1034-4987-aead-d3e1aea3eb46 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:13.256604 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5eb8f78c-1034-4987-aead-d3e1aea3eb46 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:13.257287 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5eb8f78c-1034-4987-aead-d3e1aea3eb46 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:13.257631 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-39eb255c-92b3-4b1d-8872-35443f5d0024 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:13.257724 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5eb8f78c-1034-4987-aead-d3e1aea3eb46 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:13.258110 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-39eb255c-92b3-4b1d-8872-35443f5d0024 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:13.258219 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5eb8f78c-1034-4987-aead-d3e1aea3eb46 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:13.258544 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-39eb255c-92b3-4b1d-8872-35443f5d0024 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:13.259230 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-39eb255c-92b3-4b1d-8872-35443f5d0024 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:13.259681 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-39eb255c-92b3-4b1d-8872-35443f5d0024 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:13.260123 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-39eb255c-92b3-4b1d-8872-35443f5d0024 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:13.450075 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5eb8f78c-1034-4987-aead-d3e1aea3eb46 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:13.454713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-39eb255c-92b3-4b1d-8872-35443f5d0024 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:13.460823 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5eb8f78c-1034-4987-aead-d3e1aea3eb46 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.216180 Oct 30 00:49:13.461543 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 73/147] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:13 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:13.462649 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-39eb255c-92b3-4b1d-8872-35443f5d0024 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.215967 Oct 30 00:49:13.463278 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 75/148] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:13 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:13.552574 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-bb77f587-2586-4ac3-87d6-2c36e67190c0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:13.553183 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-bb77f587-2586-4ac3-87d6-2c36e67190c0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:13.559129 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bb77f587-2586-4ac3-87d6-2c36e67190c0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:13.559639 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bb77f587-2586-4ac3-87d6-2c36e67190c0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:13.560070 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bb77f587-2586-4ac3-87d6-2c36e67190c0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:13.560785 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bb77f587-2586-4ac3-87d6-2c36e67190c0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:13.561234 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bb77f587-2586-4ac3-87d6-2c36e67190c0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:13.562410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bb77f587-2586-4ac3-87d6-2c36e67190c0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:13.564501 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-64e657d3-a802-4405-bd5e-bdd95bd3260a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:13.565174 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-64e657d3-a802-4405-bd5e-bdd95bd3260a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:13.571081 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64e657d3-a802-4405-bd5e-bdd95bd3260a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:13.571552 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64e657d3-a802-4405-bd5e-bdd95bd3260a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:13.571978 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64e657d3-a802-4405-bd5e-bdd95bd3260a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:13.572688 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64e657d3-a802-4405-bd5e-bdd95bd3260a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:13.573154 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64e657d3-a802-4405-bd5e-bdd95bd3260a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:13.573566 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64e657d3-a802-4405-bd5e-bdd95bd3260a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:13.758354 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-bb77f587-2586-4ac3-87d6-2c36e67190c0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:13.762435 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-64e657d3-a802-4405-bd5e-bdd95bd3260a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:13.766230 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-bb77f587-2586-4ac3-87d6-2c36e67190c0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.217485 Oct 30 00:49:13.766792 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 74/149] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:13 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:13.770931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-64e657d3-a802-4405-bd5e-bdd95bd3260a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:13.772421 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-64e657d3-a802-4405-bd5e-bdd95bd3260a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:13.773596 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-64e657d3-a802-4405-bd5e-bdd95bd3260a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.213965 Oct 30 00:49:13.774214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 76/150] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:13 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:14.484953 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a0eb68c2-9812-4e11-8493-749a4b7e4a73 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:14.485517 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-5df30269-83c0-4898-a6b2-62130472e21b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:14.485885 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a0eb68c2-9812-4e11-8493-749a4b7e4a73 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:14.486099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-5df30269-83c0-4898-a6b2-62130472e21b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:14.491458 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a0eb68c2-9812-4e11-8493-749a4b7e4a73 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:14.491930 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a0eb68c2-9812-4e11-8493-749a4b7e4a73 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:14.492063 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5df30269-83c0-4898-a6b2-62130472e21b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:14.492389 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a0eb68c2-9812-4e11-8493-749a4b7e4a73 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:14.492483 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5df30269-83c0-4898-a6b2-62130472e21b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:14.492875 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5df30269-83c0-4898-a6b2-62130472e21b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:14.493064 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a0eb68c2-9812-4e11-8493-749a4b7e4a73 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:14.493503 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a0eb68c2-9812-4e11-8493-749a4b7e4a73 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:14.493592 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5df30269-83c0-4898-a6b2-62130472e21b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:14.493912 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a0eb68c2-9812-4e11-8493-749a4b7e4a73 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:14.494002 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5df30269-83c0-4898-a6b2-62130472e21b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:14.494413 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5df30269-83c0-4898-a6b2-62130472e21b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:14.844990 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a0eb68c2-9812-4e11-8493-749a4b7e4a73 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:14.851554 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-5df30269-83c0-4898-a6b2-62130472e21b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:14.852671 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a0eb68c2-9812-4e11-8493-749a4b7e4a73 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.371947 Oct 30 00:49:14.853550 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 75/151] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:14 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:14.857758 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a478b1f9-dac4-4c7c-80dc-4c433b4f6244 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:14.858906 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a478b1f9-dac4-4c7c-80dc-4c433b4f6244 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:14.865034 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a478b1f9-dac4-4c7c-80dc-4c433b4f6244 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:14.865515 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a478b1f9-dac4-4c7c-80dc-4c433b4f6244 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:14.866019 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a478b1f9-dac4-4c7c-80dc-4c433b4f6244 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:14.867335 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a478b1f9-dac4-4c7c-80dc-4c433b4f6244 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:14.867806 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a478b1f9-dac4-4c7c-80dc-4c433b4f6244 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:14.868302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a478b1f9-dac4-4c7c-80dc-4c433b4f6244 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:14.874951 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-5df30269-83c0-4898-a6b2-62130472e21b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.392422 Oct 30 00:49:14.876651 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 77/152] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:14 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:14.882493 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-46b6cc19-b9af-424d-a485-7ae7ed3e36d8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:14.883191 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-46b6cc19-b9af-424d-a485-7ae7ed3e36d8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:14.890854 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-46b6cc19-b9af-424d-a485-7ae7ed3e36d8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:14.891341 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-46b6cc19-b9af-424d-a485-7ae7ed3e36d8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:14.891775 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-46b6cc19-b9af-424d-a485-7ae7ed3e36d8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:14.892526 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-46b6cc19-b9af-424d-a485-7ae7ed3e36d8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:14.893681 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-46b6cc19-b9af-424d-a485-7ae7ed3e36d8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:14.894102 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-46b6cc19-b9af-424d-a485-7ae7ed3e36d8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:15.080937 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-46b6cc19-b9af-424d-a485-7ae7ed3e36d8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:15.084199 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a478b1f9-dac4-4c7c-80dc-4c433b4f6244 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:15.090052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-46b6cc19-b9af-424d-a485-7ae7ed3e36d8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:15.092280 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-46b6cc19-b9af-424d-a485-7ae7ed3e36d8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:15.092432 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a478b1f9-dac4-4c7c-80dc-4c433b4f6244 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.237903 Oct 30 00:49:15.093771 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 76/153] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:14 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:15.094210 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-46b6cc19-b9af-424d-a485-7ae7ed3e36d8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.216454 Oct 30 00:49:15.095025 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 78/154] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:14 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:49:15.878437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-0799eda3-960f-423b-baeb-3aef3f07bcb9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:15.879229 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-0799eda3-960f-423b-baeb-3aef3f07bcb9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:15.884023 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=100 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:15.888920 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0799eda3-960f-423b-baeb-3aef3f07bcb9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:15.890520 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0799eda3-960f-423b-baeb-3aef3f07bcb9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:15.891141 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0799eda3-960f-423b-baeb-3aef3f07bcb9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:15.891998 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0799eda3-960f-423b-baeb-3aef3f07bcb9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:15.892890 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0799eda3-960f-423b-baeb-3aef3f07bcb9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:15.893988 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0799eda3-960f-423b-baeb-3aef3f07bcb9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:15.902008 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-32e87872-42e1-4bcf-a8c7-ae14a3e3d43c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:15.902609 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-32e87872-42e1-4bcf-a8c7-ae14a3e3d43c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:15.910105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-32e87872-42e1-4bcf-a8c7-ae14a3e3d43c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:15.911218 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-32e87872-42e1-4bcf-a8c7-ae14a3e3d43c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:15.911775 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-32e87872-42e1-4bcf-a8c7-ae14a3e3d43c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:15.912479 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-32e87872-42e1-4bcf-a8c7-ae14a3e3d43c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:15.912970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-32e87872-42e1-4bcf-a8c7-ae14a3e3d43c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:15.913382 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-32e87872-42e1-4bcf-a8c7-ae14a3e3d43c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:16.252493 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-0799eda3-960f-423b-baeb-3aef3f07bcb9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:16.264312 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-0799eda3-960f-423b-baeb-3aef3f07bcb9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.390585 Oct 30 00:49:16.265734 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 77/155] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:15 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:16.267592 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-32e87872-42e1-4bcf-a8c7-ae14a3e3d43c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:16.270237 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-865a184d-df25-45ed-9326-1b81c912816e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:16.271431 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-865a184d-df25-45ed-9326-1b81c912816e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:16.276801 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-865a184d-df25-45ed-9326-1b81c912816e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:16.276927 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-32e87872-42e1-4bcf-a8c7-ae14a3e3d43c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.382201 Oct 30 00:49:16.277324 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-865a184d-df25-45ed-9326-1b81c912816e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:16.277826 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 79/156] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:15 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:16.283203 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-e2eb9705-ed5e-455a-aa7e-1dc173b07dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:16.283802 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-e2eb9705-ed5e-455a-aa7e-1dc173b07dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:16.288563 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-865a184d-df25-45ed-9326-1b81c912816e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:16.289362 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-865a184d-df25-45ed-9326-1b81c912816e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:16.289575 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e2eb9705-ed5e-455a-aa7e-1dc173b07dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:16.289837 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-865a184d-df25-45ed-9326-1b81c912816e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:16.290081 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e2eb9705-ed5e-455a-aa7e-1dc173b07dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:16.290256 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-865a184d-df25-45ed-9326-1b81c912816e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:16.290512 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e2eb9705-ed5e-455a-aa7e-1dc173b07dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:16.291195 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e2eb9705-ed5e-455a-aa7e-1dc173b07dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:16.291666 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e2eb9705-ed5e-455a-aa7e-1dc173b07dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:16.292095 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e2eb9705-ed5e-455a-aa7e-1dc173b07dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:16.521386 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-865a184d-df25-45ed-9326-1b81c912816e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:16.530517 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e2eb9705-ed5e-455a-aa7e-1dc173b07dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:16.536389 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-865a184d-df25-45ed-9326-1b81c912816e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.269317 Oct 30 00:49:16.536974 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 78/157] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:16 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:16.545491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e2eb9705-ed5e-455a-aa7e-1dc173b07dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:16.548951 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e2eb9705-ed5e-455a-aa7e-1dc173b07dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:16.552025 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-e2eb9705-ed5e-455a-aa7e-1dc173b07dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.272822 Oct 30 00:49:16.554315 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 80/158] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:16 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:49:17.288831 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-831b046d-78c9-42e1-aeaa-4fb3af6bb8db tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:17.289743 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-831b046d-78c9-42e1-aeaa-4fb3af6bb8db tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:17.296028 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-831b046d-78c9-42e1-aeaa-4fb3af6bb8db tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:17.296579 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-831b046d-78c9-42e1-aeaa-4fb3af6bb8db tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:17.296948 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-831b046d-78c9-42e1-aeaa-4fb3af6bb8db tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:17.297639 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-831b046d-78c9-42e1-aeaa-4fb3af6bb8db tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:17.298189 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-831b046d-78c9-42e1-aeaa-4fb3af6bb8db tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:17.298492 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-831b046d-78c9-42e1-aeaa-4fb3af6bb8db tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:17.307912 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2b4fc34f-3498-46ce-8b4e-9451455e78ec tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:17.310091 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2b4fc34f-3498-46ce-8b4e-9451455e78ec tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:17.314966 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=100 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:17.322136 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2b4fc34f-3498-46ce-8b4e-9451455e78ec tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:17.323182 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2b4fc34f-3498-46ce-8b4e-9451455e78ec tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:17.323838 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2b4fc34f-3498-46ce-8b4e-9451455e78ec tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:17.326681 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2b4fc34f-3498-46ce-8b4e-9451455e78ec tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:17.328609 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2b4fc34f-3498-46ce-8b4e-9451455e78ec tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:17.329048 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2b4fc34f-3498-46ce-8b4e-9451455e78ec tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:17.509957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-831b046d-78c9-42e1-aeaa-4fb3af6bb8db tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:17.518920 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2b4fc34f-3498-46ce-8b4e-9451455e78ec tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:17.523665 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-831b046d-78c9-42e1-aeaa-4fb3af6bb8db tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.239567 Oct 30 00:49:17.524258 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 79/159] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:17 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:17.532000 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2b4fc34f-3498-46ce-8b4e-9451455e78ec tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.229459 Oct 30 00:49:17.532659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 81/160] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:17 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:17.562466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-fc9a135c-901b-477b-b7ab-726a8f584307 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:17.563091 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-fc9a135c-901b-477b-b7ab-726a8f584307 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:17.569415 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fc9a135c-901b-477b-b7ab-726a8f584307 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:17.569891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fc9a135c-901b-477b-b7ab-726a8f584307 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:17.570321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fc9a135c-901b-477b-b7ab-726a8f584307 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:17.571009 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fc9a135c-901b-477b-b7ab-726a8f584307 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:17.571453 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fc9a135c-901b-477b-b7ab-726a8f584307 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:17.571874 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fc9a135c-901b-477b-b7ab-726a8f584307 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:17.579566 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d4808337-80c9-4aed-a5b4-fd52828059ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:17.580531 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-d4808337-80c9-4aed-a5b4-fd52828059ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:17.587210 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d4808337-80c9-4aed-a5b4-fd52828059ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:17.588385 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d4808337-80c9-4aed-a5b4-fd52828059ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:17.588888 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d4808337-80c9-4aed-a5b4-fd52828059ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:17.589670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d4808337-80c9-4aed-a5b4-fd52828059ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:17.590333 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d4808337-80c9-4aed-a5b4-fd52828059ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:17.591101 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d4808337-80c9-4aed-a5b4-fd52828059ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:17.611807 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=100 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:17.820415 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fc9a135c-901b-477b-b7ab-726a8f584307 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:17.828692 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-fc9a135c-901b-477b-b7ab-726a8f584307 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.270859 Oct 30 00:49:17.829259 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 80/161] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:17 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:17.839007 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-d4808337-80c9-4aed-a5b4-fd52828059ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:17.847600 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-d4808337-80c9-4aed-a5b4-fd52828059ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:17.849583 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-d4808337-80c9-4aed-a5b4-fd52828059ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:17.850779 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-d4808337-80c9-4aed-a5b4-fd52828059ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.276016 Oct 30 00:49:17.851341 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 82/162] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:17 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:18.547106 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-cb35142d-8137-4b39-99fc-ee9ef32683d0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:18.547751 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-cb35142d-8137-4b39-99fc-ee9ef32683d0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:18.554506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cb35142d-8137-4b39-99fc-ee9ef32683d0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:18.554820 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-8256dac8-fff5-4e51-a226-9db8b1a25749 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:18.555261 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cb35142d-8137-4b39-99fc-ee9ef32683d0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:18.555403 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cb35142d-8137-4b39-99fc-ee9ef32683d0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:18.556182 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-8256dac8-fff5-4e51-a226-9db8b1a25749 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:18.556310 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cb35142d-8137-4b39-99fc-ee9ef32683d0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:18.556763 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cb35142d-8137-4b39-99fc-ee9ef32683d0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:18.557186 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cb35142d-8137-4b39-99fc-ee9ef32683d0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:18.562572 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8256dac8-fff5-4e51-a226-9db8b1a25749 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:18.563050 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8256dac8-fff5-4e51-a226-9db8b1a25749 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:18.564017 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8256dac8-fff5-4e51-a226-9db8b1a25749 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:18.564891 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8256dac8-fff5-4e51-a226-9db8b1a25749 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:18.565341 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8256dac8-fff5-4e51-a226-9db8b1a25749 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:18.565756 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8256dac8-fff5-4e51-a226-9db8b1a25749 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:18.757433 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-cb35142d-8137-4b39-99fc-ee9ef32683d0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:18.766661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-cb35142d-8137-4b39-99fc-ee9ef32683d0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.223678 Oct 30 00:49:18.767437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 81/163] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:18 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:18.771571 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-8256dac8-fff5-4e51-a226-9db8b1a25749 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:18.779520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-8256dac8-fff5-4e51-a226-9db8b1a25749 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.228651 Oct 30 00:49:18.780364 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 83/164] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:18 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:18.854042 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1a3f1dd9-f76b-466c-81ca-fd7801cc58cc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:18.855040 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1a3f1dd9-f76b-466c-81ca-fd7801cc58cc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:18.864906 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a3f1dd9-f76b-466c-81ca-fd7801cc58cc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:18.865770 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a3f1dd9-f76b-466c-81ca-fd7801cc58cc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:18.866664 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a3f1dd9-f76b-466c-81ca-fd7801cc58cc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:18.867811 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a3f1dd9-f76b-466c-81ca-fd7801cc58cc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:18.871161 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a3f1dd9-f76b-466c-81ca-fd7801cc58cc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:18.871161 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a3f1dd9-f76b-466c-81ca-fd7801cc58cc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:18.883038 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7a8709c4-fa34-43bb-8449-2abd3b4f75b7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:18.883795 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-7a8709c4-fa34-43bb-8449-2abd3b4f75b7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:18.890535 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7a8709c4-fa34-43bb-8449-2abd3b4f75b7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:18.891492 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7a8709c4-fa34-43bb-8449-2abd3b4f75b7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:18.892164 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7a8709c4-fa34-43bb-8449-2abd3b4f75b7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:18.893471 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7a8709c4-fa34-43bb-8449-2abd3b4f75b7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:18.896335 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7a8709c4-fa34-43bb-8449-2abd3b4f75b7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:18.897032 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7a8709c4-fa34-43bb-8449-2abd3b4f75b7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:19.096854 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1a3f1dd9-f76b-466c-81ca-fd7801cc58cc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:19.100164 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7a8709c4-fa34-43bb-8449-2abd3b4f75b7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:19.105658 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1a3f1dd9-f76b-466c-81ca-fd7801cc58cc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.258068 Oct 30 00:49:19.106227 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 82/165] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:18 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:19.110578 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7a8709c4-fa34-43bb-8449-2abd3b4f75b7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:19.112131 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7a8709c4-fa34-43bb-8449-2abd3b4f75b7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:19.113320 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7a8709c4-fa34-43bb-8449-2abd3b4f75b7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.234417 Oct 30 00:49:19.113940 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 84/166] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:18 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:19.789891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-305d0f30-425a-4f3a-b4db-9f643e9bf16b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:19.790488 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-305d0f30-425a-4f3a-b4db-9f643e9bf16b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:19.796885 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-305d0f30-425a-4f3a-b4db-9f643e9bf16b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:19.797444 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-305d0f30-425a-4f3a-b4db-9f643e9bf16b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:19.797871 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-305d0f30-425a-4f3a-b4db-9f643e9bf16b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:19.798546 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-305d0f30-425a-4f3a-b4db-9f643e9bf16b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:19.798993 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-305d0f30-425a-4f3a-b4db-9f643e9bf16b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:19.799402 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-305d0f30-425a-4f3a-b4db-9f643e9bf16b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:19.802726 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f7194d30-3663-4b40-9916-477f2ff61ae0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:19.803325 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-f7194d30-3663-4b40-9916-477f2ff61ae0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:19.809258 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f7194d30-3663-4b40-9916-477f2ff61ae0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:19.809814 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f7194d30-3663-4b40-9916-477f2ff61ae0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:19.810322 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f7194d30-3663-4b40-9916-477f2ff61ae0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:19.811061 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f7194d30-3663-4b40-9916-477f2ff61ae0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:19.812209 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f7194d30-3663-4b40-9916-477f2ff61ae0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:19.812627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f7194d30-3663-4b40-9916-477f2ff61ae0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:19.992006 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-305d0f30-425a-4f3a-b4db-9f643e9bf16b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:19.995967 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-f7194d30-3663-4b40-9916-477f2ff61ae0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:20.000394 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-305d0f30-425a-4f3a-b4db-9f643e9bf16b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.214237 Oct 30 00:49:20.000964 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 83/167] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:19 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:20.004553 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-f7194d30-3663-4b40-9916-477f2ff61ae0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.205774 Oct 30 00:49:20.005109 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 85/168] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:19 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:20.128889 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-fb9d99e0-6558-4b92-9bd0-2bafac51ae8f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:20.129485 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-fb9d99e0-6558-4b92-9bd0-2bafac51ae8f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:20.135269 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb9d99e0-6558-4b92-9bd0-2bafac51ae8f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:20.135738 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb9d99e0-6558-4b92-9bd0-2bafac51ae8f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:20.136182 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb9d99e0-6558-4b92-9bd0-2bafac51ae8f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:20.136854 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb9d99e0-6558-4b92-9bd0-2bafac51ae8f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:20.137294 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb9d99e0-6558-4b92-9bd0-2bafac51ae8f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:20.137702 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb9d99e0-6558-4b92-9bd0-2bafac51ae8f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:20.139070 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-3eedcdd3-4de9-4387-8c2b-5a42ba9bd983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:20.140267 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-3eedcdd3-4de9-4387-8c2b-5a42ba9bd983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:20.146233 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3eedcdd3-4de9-4387-8c2b-5a42ba9bd983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:20.146702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3eedcdd3-4de9-4387-8c2b-5a42ba9bd983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:20.147126 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3eedcdd3-4de9-4387-8c2b-5a42ba9bd983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:20.147800 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3eedcdd3-4de9-4387-8c2b-5a42ba9bd983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:20.148269 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3eedcdd3-4de9-4387-8c2b-5a42ba9bd983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:20.148682 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3eedcdd3-4de9-4387-8c2b-5a42ba9bd983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:20.334588 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fb9d99e0-6558-4b92-9bd0-2bafac51ae8f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:20.338134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-3eedcdd3-4de9-4387-8c2b-5a42ba9bd983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:20.342249 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-fb9d99e0-6558-4b92-9bd0-2bafac51ae8f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.217136 Oct 30 00:49:20.343481 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 84/169] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:20 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:20.346188 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-3eedcdd3-4de9-4387-8c2b-5a42ba9bd983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:20.347598 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-3eedcdd3-4de9-4387-8c2b-5a42ba9bd983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:20.348712 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-3eedcdd3-4de9-4387-8c2b-5a42ba9bd983 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.213437 Oct 30 00:49:20.349249 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 86/170] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:20 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:21.023142 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-405cb77f-35cd-48d3-adf5-9526ff11d6f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:21.023657 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-405cb77f-35cd-48d3-adf5-9526ff11d6f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:21.027458 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-8676c179-c993-4f2a-9a72-c2c12cc4a7e8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:21.028093 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-8676c179-c993-4f2a-9a72-c2c12cc4a7e8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:21.029859 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-405cb77f-35cd-48d3-adf5-9526ff11d6f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:21.030505 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-405cb77f-35cd-48d3-adf5-9526ff11d6f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:21.030937 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-405cb77f-35cd-48d3-adf5-9526ff11d6f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:21.031621 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-405cb77f-35cd-48d3-adf5-9526ff11d6f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:21.032074 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-405cb77f-35cd-48d3-adf5-9526ff11d6f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:21.032519 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-405cb77f-35cd-48d3-adf5-9526ff11d6f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:21.034298 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8676c179-c993-4f2a-9a72-c2c12cc4a7e8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:21.034778 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8676c179-c993-4f2a-9a72-c2c12cc4a7e8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:21.035213 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8676c179-c993-4f2a-9a72-c2c12cc4a7e8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:21.035895 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8676c179-c993-4f2a-9a72-c2c12cc4a7e8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:21.036370 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8676c179-c993-4f2a-9a72-c2c12cc4a7e8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:21.036793 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8676c179-c993-4f2a-9a72-c2c12cc4a7e8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:21.222665 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-405cb77f-35cd-48d3-adf5-9526ff11d6f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:21.226910 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-8676c179-c993-4f2a-9a72-c2c12cc4a7e8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:21.230310 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-405cb77f-35cd-48d3-adf5-9526ff11d6f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.211075 Oct 30 00:49:21.230868 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 85/171] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:21 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:21.244018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-8676c179-c993-4f2a-9a72-c2c12cc4a7e8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.220215 Oct 30 00:49:21.245474 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 87/172] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:21 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:21.366238 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-38e22c75-3554-471b-bd29-83e63ca10afc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:21.371797 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-38e22c75-3554-471b-bd29-83e63ca10afc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:21.373381 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ecdb4b9e-ec32-4bda-bd2b-ee1da921235e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:21.374520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ecdb4b9e-ec32-4bda-bd2b-ee1da921235e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:21.378769 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-38e22c75-3554-471b-bd29-83e63ca10afc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:21.379239 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-38e22c75-3554-471b-bd29-83e63ca10afc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:21.379659 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-38e22c75-3554-471b-bd29-83e63ca10afc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:21.380373 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-38e22c75-3554-471b-bd29-83e63ca10afc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:21.380509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ecdb4b9e-ec32-4bda-bd2b-ee1da921235e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:21.380820 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-38e22c75-3554-471b-bd29-83e63ca10afc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:21.380981 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ecdb4b9e-ec32-4bda-bd2b-ee1da921235e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:21.381227 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-38e22c75-3554-471b-bd29-83e63ca10afc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:21.381412 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ecdb4b9e-ec32-4bda-bd2b-ee1da921235e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:21.382091 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ecdb4b9e-ec32-4bda-bd2b-ee1da921235e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:21.382572 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ecdb4b9e-ec32-4bda-bd2b-ee1da921235e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:21.382988 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ecdb4b9e-ec32-4bda-bd2b-ee1da921235e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:21.571905 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ecdb4b9e-ec32-4bda-bd2b-ee1da921235e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:21.576358 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-38e22c75-3554-471b-bd29-83e63ca10afc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:21.582523 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ecdb4b9e-ec32-4bda-bd2b-ee1da921235e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:21.584285 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ecdb4b9e-ec32-4bda-bd2b-ee1da921235e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:21.585591 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ecdb4b9e-ec32-4bda-bd2b-ee1da921235e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.216533 Oct 30 00:49:21.585736 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-38e22c75-3554-471b-bd29-83e63ca10afc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.223291 Oct 30 00:49:21.586381 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 86/173] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:21 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:21.590976 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 88/174] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:21 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:22.253994 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-9ffd4be8-7265-4513-ac97-3627e863a0c1 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:22.254911 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-9ffd4be8-7265-4513-ac97-3627e863a0c1 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:22.260937 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9ffd4be8-7265-4513-ac97-3627e863a0c1 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:22.261413 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9ffd4be8-7265-4513-ac97-3627e863a0c1 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:22.261840 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9ffd4be8-7265-4513-ac97-3627e863a0c1 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:22.262520 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9ffd4be8-7265-4513-ac97-3627e863a0c1 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:22.262964 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9ffd4be8-7265-4513-ac97-3627e863a0c1 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:22.263380 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9ffd4be8-7265-4513-ac97-3627e863a0c1 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:22.267610 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2d2978c9-da4e-4f7f-b4e8-9db32bb1801f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:22.268241 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2d2978c9-da4e-4f7f-b4e8-9db32bb1801f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:22.274397 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2d2978c9-da4e-4f7f-b4e8-9db32bb1801f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:22.274882 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2d2978c9-da4e-4f7f-b4e8-9db32bb1801f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:22.275311 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2d2978c9-da4e-4f7f-b4e8-9db32bb1801f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:22.275994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2d2978c9-da4e-4f7f-b4e8-9db32bb1801f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:22.276483 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2d2978c9-da4e-4f7f-b4e8-9db32bb1801f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:22.276905 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2d2978c9-da4e-4f7f-b4e8-9db32bb1801f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:22.618050 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-9ffd4be8-7265-4513-ac97-3627e863a0c1 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:22.627026 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-9ffd4be8-7265-4513-ac97-3627e863a0c1 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.376969 Oct 30 00:49:22.627601 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 87/175] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:22 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:22.632050 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2d2978c9-da4e-4f7f-b4e8-9db32bb1801f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:22.632221 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-8706664f-13b7-4655-9954-3f11d0ecd286 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:22.632715 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-8706664f-13b7-4655-9954-3f11d0ecd286 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:22.638702 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8706664f-13b7-4655-9954-3f11d0ecd286 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:22.640191 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8706664f-13b7-4655-9954-3f11d0ecd286 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:22.641481 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8706664f-13b7-4655-9954-3f11d0ecd286 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:22.641625 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2d2978c9-da4e-4f7f-b4e8-9db32bb1801f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.377680 Oct 30 00:49:22.641851 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 89/176] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:22 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:22.646338 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8706664f-13b7-4655-9954-3f11d0ecd286 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:22.646755 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-8296a855-ccf7-46f0-bf55-99814d60472b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:22.646856 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8706664f-13b7-4655-9954-3f11d0ecd286 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:22.647370 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8706664f-13b7-4655-9954-3f11d0ecd286 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:22.647551 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-8296a855-ccf7-46f0-bf55-99814d60472b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:22.658295 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8296a855-ccf7-46f0-bf55-99814d60472b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:22.658856 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8296a855-ccf7-46f0-bf55-99814d60472b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:22.659433 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8296a855-ccf7-46f0-bf55-99814d60472b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:22.660378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8296a855-ccf7-46f0-bf55-99814d60472b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:22.660930 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8296a855-ccf7-46f0-bf55-99814d60472b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:22.661419 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8296a855-ccf7-46f0-bf55-99814d60472b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:22.853262 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8706664f-13b7-4655-9954-3f11d0ecd286 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:22.856918 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-8296a855-ccf7-46f0-bf55-99814d60472b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:22.861756 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-8706664f-13b7-4655-9954-3f11d0ecd286 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.233114 Oct 30 00:49:22.862318 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 88/177] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:22 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:22.866588 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-8296a855-ccf7-46f0-bf55-99814d60472b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:22.868156 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-8296a855-ccf7-46f0-bf55-99814d60472b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:22.869839 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-8296a855-ccf7-46f0-bf55-99814d60472b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.226827 Oct 30 00:49:22.870486 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 90/178] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:22 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:49:23.650888 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-aeb2bdb2-de16-4bc5-b92a-4b5ecb26ec1b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:23.651523 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-aeb2bdb2-de16-4bc5-b92a-4b5ecb26ec1b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:23.657811 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aeb2bdb2-de16-4bc5-b92a-4b5ecb26ec1b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:23.658288 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aeb2bdb2-de16-4bc5-b92a-4b5ecb26ec1b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:23.658722 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aeb2bdb2-de16-4bc5-b92a-4b5ecb26ec1b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:23.659631 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aeb2bdb2-de16-4bc5-b92a-4b5ecb26ec1b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:23.660123 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aeb2bdb2-de16-4bc5-b92a-4b5ecb26ec1b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:23.660552 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aeb2bdb2-de16-4bc5-b92a-4b5ecb26ec1b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:23.664498 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-148c9835-d207-4e6a-967c-1bca0ae4bfba tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:23.665098 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-148c9835-d207-4e6a-967c-1bca0ae4bfba tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:23.671158 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-148c9835-d207-4e6a-967c-1bca0ae4bfba tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:23.671562 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-148c9835-d207-4e6a-967c-1bca0ae4bfba tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:23.671992 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-148c9835-d207-4e6a-967c-1bca0ae4bfba tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:23.672709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-148c9835-d207-4e6a-967c-1bca0ae4bfba tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:23.673156 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-148c9835-d207-4e6a-967c-1bca0ae4bfba tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:23.673573 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-148c9835-d207-4e6a-967c-1bca0ae4bfba tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:23.867781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-148c9835-d207-4e6a-967c-1bca0ae4bfba tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:23.871363 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-aeb2bdb2-de16-4bc5-b92a-4b5ecb26ec1b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:23.880208 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-148c9835-d207-4e6a-967c-1bca0ae4bfba tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.218808 Oct 30 00:49:23.880665 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-aeb2bdb2-de16-4bc5-b92a-4b5ecb26ec1b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.233764 Oct 30 00:49:23.881226 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 89/179] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:23 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:23.897007 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 91/180] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:23 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:23.902399 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-92cb18ef-2540-40a2-a639-cdcbc34bfe99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:23.904030 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f5e51541-6c74-48d8-a955-ba9ed02847b5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:23.904668 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f5e51541-6c74-48d8-a955-ba9ed02847b5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:23.905427 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-92cb18ef-2540-40a2-a639-cdcbc34bfe99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:23.911156 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f5e51541-6c74-48d8-a955-ba9ed02847b5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:23.911913 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f5e51541-6c74-48d8-a955-ba9ed02847b5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:23.912548 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f5e51541-6c74-48d8-a955-ba9ed02847b5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:23.913235 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f5e51541-6c74-48d8-a955-ba9ed02847b5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:23.913686 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f5e51541-6c74-48d8-a955-ba9ed02847b5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:23.914104 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f5e51541-6c74-48d8-a955-ba9ed02847b5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:23.914223 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-92cb18ef-2540-40a2-a639-cdcbc34bfe99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:23.915727 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-92cb18ef-2540-40a2-a639-cdcbc34bfe99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:23.916203 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-92cb18ef-2540-40a2-a639-cdcbc34bfe99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:23.917167 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-92cb18ef-2540-40a2-a639-cdcbc34bfe99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:23.917631 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-92cb18ef-2540-40a2-a639-cdcbc34bfe99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:23.918061 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-92cb18ef-2540-40a2-a639-cdcbc34bfe99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:24.127397 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-92cb18ef-2540-40a2-a639-cdcbc34bfe99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:24.131476 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f5e51541-6c74-48d8-a955-ba9ed02847b5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:24.135556 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-92cb18ef-2540-40a2-a639-cdcbc34bfe99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:24.137116 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-92cb18ef-2540-40a2-a639-cdcbc34bfe99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:24.138282 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-92cb18ef-2540-40a2-a639-cdcbc34bfe99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.240093 Oct 30 00:49:24.138917 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 92/181] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:23 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:49:24.139158 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f5e51541-6c74-48d8-a955-ba9ed02847b5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.245277 Oct 30 00:49:24.140476 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 90/182] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:23 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:24.902572 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2c90dd78-3b38-40f9-a308-6823120f2f54 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:24.903172 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2c90dd78-3b38-40f9-a308-6823120f2f54 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:24.907424 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-bcf8db64-f6d2-48ed-ad8c-865bd166f1c4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:24.908027 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-bcf8db64-f6d2-48ed-ad8c-865bd166f1c4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:24.911208 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2c90dd78-3b38-40f9-a308-6823120f2f54 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:24.911755 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2c90dd78-3b38-40f9-a308-6823120f2f54 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:24.912291 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2c90dd78-3b38-40f9-a308-6823120f2f54 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:24.912969 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2c90dd78-3b38-40f9-a308-6823120f2f54 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:24.913486 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2c90dd78-3b38-40f9-a308-6823120f2f54 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:24.913912 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2c90dd78-3b38-40f9-a308-6823120f2f54 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:24.914772 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bcf8db64-f6d2-48ed-ad8c-865bd166f1c4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:24.915423 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bcf8db64-f6d2-48ed-ad8c-865bd166f1c4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:24.915854 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bcf8db64-f6d2-48ed-ad8c-865bd166f1c4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:24.916758 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bcf8db64-f6d2-48ed-ad8c-865bd166f1c4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:24.917209 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bcf8db64-f6d2-48ed-ad8c-865bd166f1c4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:24.917631 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bcf8db64-f6d2-48ed-ad8c-865bd166f1c4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:25.137982 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2c90dd78-3b38-40f9-a308-6823120f2f54 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:25.148502 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2c90dd78-3b38-40f9-a308-6823120f2f54 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.249380 Oct 30 00:49:25.165860 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 93/183] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:24 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:25.170078 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-069cc4e2-8741-4a2e-856e-e16d444b2bd4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:25.171707 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-069cc4e2-8741-4a2e-856e-e16d444b2bd4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:25.180388 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-bcf8db64-f6d2-48ed-ad8c-865bd166f1c4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:25.192784 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-bcf8db64-f6d2-48ed-ad8c-865bd166f1c4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.288252 Oct 30 00:49:25.197730 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-069cc4e2-8741-4a2e-856e-e16d444b2bd4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:25.198218 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-069cc4e2-8741-4a2e-856e-e16d444b2bd4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:25.200400 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 91/184] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:24 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:25.205589 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-069cc4e2-8741-4a2e-856e-e16d444b2bd4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:25.206953 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-069cc4e2-8741-4a2e-856e-e16d444b2bd4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:25.207415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-069cc4e2-8741-4a2e-856e-e16d444b2bd4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:25.207897 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-069cc4e2-8741-4a2e-856e-e16d444b2bd4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:25.214527 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-9975b51d-d360-4ae8-bd40-d48f37f10977 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:25.215351 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-9975b51d-d360-4ae8-bd40-d48f37f10977 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:25.222018 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9975b51d-d360-4ae8-bd40-d48f37f10977 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:25.222535 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9975b51d-d360-4ae8-bd40-d48f37f10977 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:25.223067 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9975b51d-d360-4ae8-bd40-d48f37f10977 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:25.223792 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9975b51d-d360-4ae8-bd40-d48f37f10977 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:25.224283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9975b51d-d360-4ae8-bd40-d48f37f10977 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:25.224697 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9975b51d-d360-4ae8-bd40-d48f37f10977 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:25.579075 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-9975b51d-d360-4ae8-bd40-d48f37f10977 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:25.586793 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-9975b51d-d360-4ae8-bd40-d48f37f10977 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.385503 Oct 30 00:49:25.587348 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 92/185] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:25 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:25.593445 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-68e76384-3a31-4574-8c73-a92f4a9caad1 req-8f3e349b-9076-4a1c-9a0d-9c7be2bced3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa96626-2d37-41bc-8beb-ed93a5a90f85", "name": "network-vif-plugged", "status": "completed", "tag": "b4275094-f698-4ced-a85a-305d1f639c55"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:49:25.606088 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-68e76384-3a31-4574-8c73-a92f4a9caad1 req-8f3e349b-9076-4a1c-9a0d-9c7be2bced3c service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:25.606564 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-68e76384-3a31-4574-8c73-a92f4a9caad1 req-8f3e349b-9076-4a1c-9a0d-9c7be2bced3c service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:25.606989 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-68e76384-3a31-4574-8c73-a92f4a9caad1 req-8f3e349b-9076-4a1c-9a0d-9c7be2bced3c service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:25.619252 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-68e76384-3a31-4574-8c73-a92f4a9caad1 req-8f3e349b-9076-4a1c-9a0d-9c7be2bced3c service nova] Creating event network-vif-plugged:b4275094-f698-4ced-a85a-305d1f639c55 for instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 on hv-cinder-86149 Oct 30 00:49:25.624793 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-68e76384-3a31-4574-8c73-a92f4a9caad1 req-8f3e349b-9076-4a1c-9a0d-9c7be2bced3c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036163 Oct 30 00:49:25.625452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 93/186] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:49:25.632854 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-069cc4e2-8741-4a2e-856e-e16d444b2bd4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:25.644273 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-069cc4e2-8741-4a2e-856e-e16d444b2bd4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:25.649800 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-069cc4e2-8741-4a2e-856e-e16d444b2bd4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:25.652869 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-069cc4e2-8741-4a2e-856e-e16d444b2bd4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.489805 Oct 30 00:49:25.653711 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 94/187] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:25 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:49:26.176176 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-cd41ca14-ac3e-47a3-b28f-4385529f8c1f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:26.176890 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-cd41ca14-ac3e-47a3-b28f-4385529f8c1f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:26.183139 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd41ca14-ac3e-47a3-b28f-4385529f8c1f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:26.183583 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd41ca14-ac3e-47a3-b28f-4385529f8c1f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:26.184018 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd41ca14-ac3e-47a3-b28f-4385529f8c1f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:26.184728 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd41ca14-ac3e-47a3-b28f-4385529f8c1f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:26.185175 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd41ca14-ac3e-47a3-b28f-4385529f8c1f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:26.185589 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd41ca14-ac3e-47a3-b28f-4385529f8c1f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:26.216667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-bf65b74f-29f4-4b46-bd92-79945d67ee0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:26.217476 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-bf65b74f-29f4-4b46-bd92-79945d67ee0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:26.223583 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bf65b74f-29f4-4b46-bd92-79945d67ee0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:26.224176 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bf65b74f-29f4-4b46-bd92-79945d67ee0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:26.224682 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bf65b74f-29f4-4b46-bd92-79945d67ee0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:26.225443 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bf65b74f-29f4-4b46-bd92-79945d67ee0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:26.225966 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bf65b74f-29f4-4b46-bd92-79945d67ee0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:26.226454 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bf65b74f-29f4-4b46-bd92-79945d67ee0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:26.371529 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-cd41ca14-ac3e-47a3-b28f-4385529f8c1f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:26.379807 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-cd41ca14-ac3e-47a3-b28f-4385529f8c1f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.208228 Oct 30 00:49:26.380610 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 94/188] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:26 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:26.391859 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-bf65b74f-29f4-4b46-bd92-79945d67ee0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:26.399364 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-bf65b74f-29f4-4b46-bd92-79945d67ee0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.186459 Oct 30 00:49:26.399915 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 95/189] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:26 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:26.616284 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e1d1bc72-8a35-484e-a73b-4d93bbd2d02c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:26.616284 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-e1d1bc72-8a35-484e-a73b-4d93bbd2d02c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:26.620053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e1d1bc72-8a35-484e-a73b-4d93bbd2d02c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:26.620651 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e1d1bc72-8a35-484e-a73b-4d93bbd2d02c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:26.621153 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e1d1bc72-8a35-484e-a73b-4d93bbd2d02c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:26.621898 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e1d1bc72-8a35-484e-a73b-4d93bbd2d02c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:26.622417 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e1d1bc72-8a35-484e-a73b-4d93bbd2d02c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:26.622898 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e1d1bc72-8a35-484e-a73b-4d93bbd2d02c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:26.681139 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2da509da-960f-49c3-9e93-5dab0d403726 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:26.681745 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2da509da-960f-49c3-9e93-5dab0d403726 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:26.691873 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2da509da-960f-49c3-9e93-5dab0d403726 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:26.693413 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2da509da-960f-49c3-9e93-5dab0d403726 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:26.693853 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2da509da-960f-49c3-9e93-5dab0d403726 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:26.696070 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2da509da-960f-49c3-9e93-5dab0d403726 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:26.696568 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2da509da-960f-49c3-9e93-5dab0d403726 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:26.696994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2da509da-960f-49c3-9e93-5dab0d403726 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:26.797516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-e1d1bc72-8a35-484e-a73b-4d93bbd2d02c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:26.809692 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e1d1bc72-8a35-484e-a73b-4d93bbd2d02c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.199974 Oct 30 00:49:26.824499 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 95/190] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:26 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:26.867934 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2da509da-960f-49c3-9e93-5dab0d403726 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:26.877069 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2da509da-960f-49c3-9e93-5dab0d403726 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:26.879409 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2da509da-960f-49c3-9e93-5dab0d403726 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:26.881398 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2da509da-960f-49c3-9e93-5dab0d403726 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.204059 Oct 30 00:49:26.882014 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 96/191] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:26 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:27.401986 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-500aeeee-b682-450b-b653-41b2dce92a29 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:27.402627 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-500aeeee-b682-450b-b653-41b2dce92a29 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:27.411047 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-500aeeee-b682-450b-b653-41b2dce92a29 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:27.411047 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-500aeeee-b682-450b-b653-41b2dce92a29 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:27.411047 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-500aeeee-b682-450b-b653-41b2dce92a29 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:27.411564 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-500aeeee-b682-450b-b653-41b2dce92a29 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:27.412004 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-500aeeee-b682-450b-b653-41b2dce92a29 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:27.412448 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-500aeeee-b682-450b-b653-41b2dce92a29 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:27.421751 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-23105144-f870-424d-be52-8f23b3ffe6b0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:27.422355 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-23105144-f870-424d-be52-8f23b3ffe6b0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:27.430295 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-23105144-f870-424d-be52-8f23b3ffe6b0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:27.430761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-23105144-f870-424d-be52-8f23b3ffe6b0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:27.431180 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-23105144-f870-424d-be52-8f23b3ffe6b0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:27.431865 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-23105144-f870-424d-be52-8f23b3ffe6b0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:27.432329 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-23105144-f870-424d-be52-8f23b3ffe6b0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:27.432743 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-23105144-f870-424d-be52-8f23b3ffe6b0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:27.628562 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-500aeeee-b682-450b-b653-41b2dce92a29 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:27.630935 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=100 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:27.637571 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-500aeeee-b682-450b-b653-41b2dce92a29 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.239366 Oct 30 00:49:27.638133 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 96/192] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:27 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:27.641732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-23105144-f870-424d-be52-8f23b3ffe6b0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:27.649822 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-23105144-f870-424d-be52-8f23b3ffe6b0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.232545 Oct 30 00:49:27.650376 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 97/193] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:27 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:27.833253 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3574823b-7dbf-4e7d-9c8b-450bf1ca749e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:27.833889 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-3574823b-7dbf-4e7d-9c8b-450bf1ca749e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:27.839733 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3574823b-7dbf-4e7d-9c8b-450bf1ca749e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:27.840240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3574823b-7dbf-4e7d-9c8b-450bf1ca749e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:27.840697 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3574823b-7dbf-4e7d-9c8b-450bf1ca749e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:27.841373 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3574823b-7dbf-4e7d-9c8b-450bf1ca749e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:27.841825 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3574823b-7dbf-4e7d-9c8b-450bf1ca749e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:27.842356 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3574823b-7dbf-4e7d-9c8b-450bf1ca749e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:27.907105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-5924fa17-e8f7-47f4-91fb-d45d7fd7ddbd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:27.907840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-5924fa17-e8f7-47f4-91fb-d45d7fd7ddbd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:27.914031 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5924fa17-e8f7-47f4-91fb-d45d7fd7ddbd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:27.914498 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5924fa17-e8f7-47f4-91fb-d45d7fd7ddbd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:27.914927 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5924fa17-e8f7-47f4-91fb-d45d7fd7ddbd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:27.915599 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5924fa17-e8f7-47f4-91fb-d45d7fd7ddbd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:27.916039 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5924fa17-e8f7-47f4-91fb-d45d7fd7ddbd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:27.916475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5924fa17-e8f7-47f4-91fb-d45d7fd7ddbd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:28.000437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3574823b-7dbf-4e7d-9c8b-450bf1ca749e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:28.008216 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-3574823b-7dbf-4e7d-9c8b-450bf1ca749e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.178921 Oct 30 00:49:28.008785 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 97/194] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:27 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:28.070248 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-5924fa17-e8f7-47f4-91fb-d45d7fd7ddbd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:28.079435 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-5924fa17-e8f7-47f4-91fb-d45d7fd7ddbd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:28.080874 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-5924fa17-e8f7-47f4-91fb-d45d7fd7ddbd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:28.081950 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-5924fa17-e8f7-47f4-91fb-d45d7fd7ddbd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.179033 Oct 30 00:49:28.082499 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 98/195] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:27 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:28.661152 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-485ff84d-3f02-47bf-ac7b-286cc1c82de7 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:28.661758 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-485ff84d-3f02-47bf-ac7b-286cc1c82de7 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:28.667856 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-485ff84d-3f02-47bf-ac7b-286cc1c82de7 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:28.668373 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-485ff84d-3f02-47bf-ac7b-286cc1c82de7 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:28.668809 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-485ff84d-3f02-47bf-ac7b-286cc1c82de7 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:28.669492 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-485ff84d-3f02-47bf-ac7b-286cc1c82de7 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:28.669939 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-485ff84d-3f02-47bf-ac7b-286cc1c82de7 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:28.670498 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-485ff84d-3f02-47bf-ac7b-286cc1c82de7 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:28.673729 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-95601aff-977d-48d2-ae00-d74364c2f2d0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:28.674361 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-95601aff-977d-48d2-ae00-d74364c2f2d0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:28.680247 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-95601aff-977d-48d2-ae00-d74364c2f2d0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:28.680720 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-95601aff-977d-48d2-ae00-d74364c2f2d0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:28.681141 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-95601aff-977d-48d2-ae00-d74364c2f2d0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:28.681830 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-95601aff-977d-48d2-ae00-d74364c2f2d0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:28.682271 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-95601aff-977d-48d2-ae00-d74364c2f2d0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:28.682684 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-95601aff-977d-48d2-ae00-d74364c2f2d0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:28.687104 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=100 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:28.874181 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-485ff84d-3f02-47bf-ac7b-286cc1c82de7 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:28.877408 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-95601aff-977d-48d2-ae00-d74364c2f2d0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:28.882071 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-485ff84d-3f02-47bf-ac7b-286cc1c82de7 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.224682 Oct 30 00:49:28.882632 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 98/196] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:28 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:28.886859 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-95601aff-977d-48d2-ae00-d74364c2f2d0 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.217739 Oct 30 00:49:28.887406 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 99/197] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:28 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:29.034353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-fb2b7f40-0623-45f1-8191-bf266d66e53e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:29.034957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-fb2b7f40-0623-45f1-8191-bf266d66e53e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:29.040923 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb2b7f40-0623-45f1-8191-bf266d66e53e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:29.041398 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb2b7f40-0623-45f1-8191-bf266d66e53e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:29.041834 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb2b7f40-0623-45f1-8191-bf266d66e53e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:29.042520 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb2b7f40-0623-45f1-8191-bf266d66e53e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:29.042975 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb2b7f40-0623-45f1-8191-bf266d66e53e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:29.043397 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb2b7f40-0623-45f1-8191-bf266d66e53e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:29.107042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-30fa5bf8-02c2-452a-9c96-f534b253f081 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:29.107558 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-30fa5bf8-02c2-452a-9c96-f534b253f081 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:29.113643 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30fa5bf8-02c2-452a-9c96-f534b253f081 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:29.114121 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30fa5bf8-02c2-452a-9c96-f534b253f081 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:29.114549 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30fa5bf8-02c2-452a-9c96-f534b253f081 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:29.115241 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30fa5bf8-02c2-452a-9c96-f534b253f081 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:29.115687 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30fa5bf8-02c2-452a-9c96-f534b253f081 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:29.116119 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30fa5bf8-02c2-452a-9c96-f534b253f081 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:29.206012 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fb2b7f40-0623-45f1-8191-bf266d66e53e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:29.213802 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-fb2b7f40-0623-45f1-8191-bf266d66e53e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.184020 Oct 30 00:49:29.214359 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 99/198] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:29 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:29.260343 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-30fa5bf8-02c2-452a-9c96-f534b253f081 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:29.269011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-30fa5bf8-02c2-452a-9c96-f534b253f081 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:29.270447 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-30fa5bf8-02c2-452a-9c96-f534b253f081 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:29.271526 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-30fa5bf8-02c2-452a-9c96-f534b253f081 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.168623 Oct 30 00:49:29.272076 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 100/199] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:29 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:49:29.906138 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-70bb29ba-88af-40de-983f-42a800601334 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:29.920783 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-70bb29ba-88af-40de-983f-42a800601334 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:29.920995 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-708a44e7-74ef-435e-91ff-3b70645ddb9f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:29.920995 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-708a44e7-74ef-435e-91ff-3b70645ddb9f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:29.921495 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-70bb29ba-88af-40de-983f-42a800601334 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:29.921495 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-70bb29ba-88af-40de-983f-42a800601334 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:29.921495 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-70bb29ba-88af-40de-983f-42a800601334 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:29.921495 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-70bb29ba-88af-40de-983f-42a800601334 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:29.921816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-70bb29ba-88af-40de-983f-42a800601334 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:29.921816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-70bb29ba-88af-40de-983f-42a800601334 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:29.921980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-708a44e7-74ef-435e-91ff-3b70645ddb9f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:29.921980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-708a44e7-74ef-435e-91ff-3b70645ddb9f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:29.921980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-708a44e7-74ef-435e-91ff-3b70645ddb9f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:29.921980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-708a44e7-74ef-435e-91ff-3b70645ddb9f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:29.922265 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-708a44e7-74ef-435e-91ff-3b70645ddb9f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:29.922265 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-708a44e7-74ef-435e-91ff-3b70645ddb9f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:30.107232 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-708a44e7-74ef-435e-91ff-3b70645ddb9f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:30.114858 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-70bb29ba-88af-40de-983f-42a800601334 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:30.115578 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-708a44e7-74ef-435e-91ff-3b70645ddb9f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.209317 Oct 30 00:49:30.116314 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 101/200] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:29 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:30.122543 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-70bb29ba-88af-40de-983f-42a800601334 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.220694 Oct 30 00:49:30.123102 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 100/201] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:29 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:30.237746 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-55ccb4ae-ba3e-444f-b3fc-2fb9d227532c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:30.238348 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-55ccb4ae-ba3e-444f-b3fc-2fb9d227532c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:30.244285 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55ccb4ae-ba3e-444f-b3fc-2fb9d227532c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:30.244768 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55ccb4ae-ba3e-444f-b3fc-2fb9d227532c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:30.245197 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55ccb4ae-ba3e-444f-b3fc-2fb9d227532c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:30.245877 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55ccb4ae-ba3e-444f-b3fc-2fb9d227532c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:30.246333 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55ccb4ae-ba3e-444f-b3fc-2fb9d227532c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:30.246744 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55ccb4ae-ba3e-444f-b3fc-2fb9d227532c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:30.298209 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3559e3dc-cd09-4951-ac7c-bfa651efdcb9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:30.298844 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-3559e3dc-cd09-4951-ac7c-bfa651efdcb9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:30.304778 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3559e3dc-cd09-4951-ac7c-bfa651efdcb9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:30.305256 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3559e3dc-cd09-4951-ac7c-bfa651efdcb9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:30.305679 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3559e3dc-cd09-4951-ac7c-bfa651efdcb9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:30.306354 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3559e3dc-cd09-4951-ac7c-bfa651efdcb9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:30.306796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3559e3dc-cd09-4951-ac7c-bfa651efdcb9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:30.307209 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3559e3dc-cd09-4951-ac7c-bfa651efdcb9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:30.417180 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-55ccb4ae-ba3e-444f-b3fc-2fb9d227532c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:30.425549 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-55ccb4ae-ba3e-444f-b3fc-2fb9d227532c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.191586 Oct 30 00:49:30.426117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 102/202] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:30 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:30.461712 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3559e3dc-cd09-4951-ac7c-bfa651efdcb9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:30.470933 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3559e3dc-cd09-4951-ac7c-bfa651efdcb9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:30.472366 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3559e3dc-cd09-4951-ac7c-bfa651efdcb9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:30.473457 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-3559e3dc-cd09-4951-ac7c-bfa651efdcb9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.180311 Oct 30 00:49:30.474000 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 101/203] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:30 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:31.138530 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-aa9eff28-ed73-4bbb-8c73-f40b65ba8328 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:31.139517 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-aa9eff28-ed73-4bbb-8c73-f40b65ba8328 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:31.145433 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-8450c2fa-39f6-46d1-808c-bbcdf0fe3c49 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:31.146016 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-aa9eff28-ed73-4bbb-8c73-f40b65ba8328 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:31.146116 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-8450c2fa-39f6-46d1-808c-bbcdf0fe3c49 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:31.146502 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-aa9eff28-ed73-4bbb-8c73-f40b65ba8328 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:31.146935 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-aa9eff28-ed73-4bbb-8c73-f40b65ba8328 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:31.147626 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-aa9eff28-ed73-4bbb-8c73-f40b65ba8328 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:31.148093 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-aa9eff28-ed73-4bbb-8c73-f40b65ba8328 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:31.148522 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-aa9eff28-ed73-4bbb-8c73-f40b65ba8328 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:31.151965 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8450c2fa-39f6-46d1-808c-bbcdf0fe3c49 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:31.152468 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8450c2fa-39f6-46d1-808c-bbcdf0fe3c49 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:31.152899 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8450c2fa-39f6-46d1-808c-bbcdf0fe3c49 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:31.153579 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8450c2fa-39f6-46d1-808c-bbcdf0fe3c49 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:31.154032 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8450c2fa-39f6-46d1-808c-bbcdf0fe3c49 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:31.154452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8450c2fa-39f6-46d1-808c-bbcdf0fe3c49 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:31.344048 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-aa9eff28-ed73-4bbb-8c73-f40b65ba8328 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:31.348574 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8450c2fa-39f6-46d1-808c-bbcdf0fe3c49 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:31.352397 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-aa9eff28-ed73-4bbb-8c73-f40b65ba8328 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.217523 Oct 30 00:49:31.353288 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 103/204] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:31 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:31.356678 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-8450c2fa-39f6-46d1-808c-bbcdf0fe3c49 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.215012 Oct 30 00:49:31.357231 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 102/205] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:31 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:31.449105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-e3cfebb1-8a71-4591-9d36-1ec550bb3f0c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:31.449702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-e3cfebb1-8a71-4591-9d36-1ec550bb3f0c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:31.456061 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e3cfebb1-8a71-4591-9d36-1ec550bb3f0c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:31.456561 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e3cfebb1-8a71-4591-9d36-1ec550bb3f0c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:31.456987 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e3cfebb1-8a71-4591-9d36-1ec550bb3f0c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:31.457655 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e3cfebb1-8a71-4591-9d36-1ec550bb3f0c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:31.458187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e3cfebb1-8a71-4591-9d36-1ec550bb3f0c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:31.458741 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e3cfebb1-8a71-4591-9d36-1ec550bb3f0c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:31.498345 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-53880208-1c42-4bfb-be04-6f6fa61041a7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:31.499680 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-53880208-1c42-4bfb-be04-6f6fa61041a7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:31.505725 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-53880208-1c42-4bfb-be04-6f6fa61041a7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:31.506203 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-53880208-1c42-4bfb-be04-6f6fa61041a7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:31.506632 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-53880208-1c42-4bfb-be04-6f6fa61041a7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:31.507317 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-53880208-1c42-4bfb-be04-6f6fa61041a7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:31.507762 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-53880208-1c42-4bfb-be04-6f6fa61041a7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:31.508207 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-53880208-1c42-4bfb-be04-6f6fa61041a7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:31.659407 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e3cfebb1-8a71-4591-9d36-1ec550bb3f0c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:31.668431 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-e3cfebb1-8a71-4591-9d36-1ec550bb3f0c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.222704 Oct 30 00:49:31.681619 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 104/206] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:31 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:31.717221 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-53880208-1c42-4bfb-be04-6f6fa61041a7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:31.727645 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-53880208-1c42-4bfb-be04-6f6fa61041a7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:31.730100 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-53880208-1c42-4bfb-be04-6f6fa61041a7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:31.731174 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-53880208-1c42-4bfb-be04-6f6fa61041a7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.236656 Oct 30 00:49:31.732417 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 103/207] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:31 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:32.376716 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-39a5a18f-7b3e-4c02-947e-5042d2dad5fb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:32.377247 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-39a5a18f-7b3e-4c02-947e-5042d2dad5fb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:32.379782 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-962a3f7c-0c29-4c92-8336-d5dff4f8cb7d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:32.380415 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-962a3f7c-0c29-4c92-8336-d5dff4f8cb7d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:32.383388 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-39a5a18f-7b3e-4c02-947e-5042d2dad5fb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:32.383869 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-39a5a18f-7b3e-4c02-947e-5042d2dad5fb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:32.384331 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-39a5a18f-7b3e-4c02-947e-5042d2dad5fb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:32.385018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-39a5a18f-7b3e-4c02-947e-5042d2dad5fb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:32.385471 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-39a5a18f-7b3e-4c02-947e-5042d2dad5fb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:32.385890 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-39a5a18f-7b3e-4c02-947e-5042d2dad5fb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:32.386165 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-962a3f7c-0c29-4c92-8336-d5dff4f8cb7d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:32.386640 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-962a3f7c-0c29-4c92-8336-d5dff4f8cb7d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:32.387071 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-962a3f7c-0c29-4c92-8336-d5dff4f8cb7d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:32.387751 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-962a3f7c-0c29-4c92-8336-d5dff4f8cb7d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:32.388223 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-962a3f7c-0c29-4c92-8336-d5dff4f8cb7d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:32.388638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-962a3f7c-0c29-4c92-8336-d5dff4f8cb7d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:32.580133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-39a5a18f-7b3e-4c02-947e-5042d2dad5fb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:32.584181 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-962a3f7c-0c29-4c92-8336-d5dff4f8cb7d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:32.588014 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-39a5a18f-7b3e-4c02-947e-5042d2dad5fb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.215289 Oct 30 00:49:32.588609 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 105/208] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:32 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:32.591908 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-962a3f7c-0c29-4c92-8336-d5dff4f8cb7d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.215820 Oct 30 00:49:32.592771 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 104/209] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:32 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:32.692879 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f327e4e8-645a-4f67-9ced-2d8d21300790 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:32.693491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-f327e4e8-645a-4f67-9ced-2d8d21300790 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:32.700443 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f327e4e8-645a-4f67-9ced-2d8d21300790 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:32.700908 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f327e4e8-645a-4f67-9ced-2d8d21300790 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:32.701409 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f327e4e8-645a-4f67-9ced-2d8d21300790 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:32.702734 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f327e4e8-645a-4f67-9ced-2d8d21300790 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:32.703212 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f327e4e8-645a-4f67-9ced-2d8d21300790 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:32.703659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f327e4e8-645a-4f67-9ced-2d8d21300790 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:32.761074 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d276a336-a166-423f-858d-0a31ffb9f8eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:32.761723 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d276a336-a166-423f-858d-0a31ffb9f8eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:32.769725 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d276a336-a166-423f-858d-0a31ffb9f8eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:32.770211 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d276a336-a166-423f-858d-0a31ffb9f8eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:32.770640 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d276a336-a166-423f-858d-0a31ffb9f8eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:32.771349 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d276a336-a166-423f-858d-0a31ffb9f8eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:32.771827 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d276a336-a166-423f-858d-0a31ffb9f8eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:32.772673 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d276a336-a166-423f-858d-0a31ffb9f8eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:32.878831 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-f327e4e8-645a-4f67-9ced-2d8d21300790 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:32.888336 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-f327e4e8-645a-4f67-9ced-2d8d21300790 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.199239 Oct 30 00:49:32.891336 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 106/210] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:32 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:32.973055 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d276a336-a166-423f-858d-0a31ffb9f8eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:32.981378 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d276a336-a166-423f-858d-0a31ffb9f8eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:32.983392 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d276a336-a166-423f-858d-0a31ffb9f8eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:32.985258 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d276a336-a166-423f-858d-0a31ffb9f8eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.228045 Oct 30 00:49:32.986034 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 105/211] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:32 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:33.283215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-78239b1e-00db-4c77-8d7b-9b3192958d30 req-b9048b4e-f208-4bd3-a84b-61e8cd4f8595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1bf0cdf-a838-4e0c-a56f-707f90711978", "name": "network-vif-plugged", "status": "completed", "tag": "1a9df18b-56de-4bc7-8368-87528ddf8143"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:49:33.295471 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-78239b1e-00db-4c77-8d7b-9b3192958d30 req-b9048b4e-f208-4bd3-a84b-61e8cd4f8595 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:33.296358 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-78239b1e-00db-4c77-8d7b-9b3192958d30 req-b9048b4e-f208-4bd3-a84b-61e8cd4f8595 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:33.296988 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-78239b1e-00db-4c77-8d7b-9b3192958d30 req-b9048b4e-f208-4bd3-a84b-61e8cd4f8595 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:33.312872 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-78239b1e-00db-4c77-8d7b-9b3192958d30 req-b9048b4e-f208-4bd3-a84b-61e8cd4f8595 service nova] Creating event network-vif-plugged:1a9df18b-56de-4bc7-8368-87528ddf8143 for instance a1bf0cdf-a838-4e0c-a56f-707f90711978 on hv-cinder-86149 Oct 30 00:49:33.319736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-78239b1e-00db-4c77-8d7b-9b3192958d30 req-b9048b4e-f208-4bd3-a84b-61e8cd4f8595 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041337 Oct 30 00:49:33.323322 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 107/212] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:49:33.613655 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-ddf72932-7c3a-4694-9367-57017337413e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:33.614905 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-ddf72932-7c3a-4694-9367-57017337413e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:33.617071 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-a17037fc-dfd7-47eb-95ca-a664ef6a1d84 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:33.617870 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-a17037fc-dfd7-47eb-95ca-a664ef6a1d84 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:33.621998 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ddf72932-7c3a-4694-9367-57017337413e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:33.622843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ddf72932-7c3a-4694-9367-57017337413e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:33.624031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ddf72932-7c3a-4694-9367-57017337413e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:33.625098 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ddf72932-7c3a-4694-9367-57017337413e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:33.625251 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a17037fc-dfd7-47eb-95ca-a664ef6a1d84 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:33.625725 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a17037fc-dfd7-47eb-95ca-a664ef6a1d84 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:33.626121 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ddf72932-7c3a-4694-9367-57017337413e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:33.626241 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a17037fc-dfd7-47eb-95ca-a664ef6a1d84 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:33.626829 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ddf72932-7c3a-4694-9367-57017337413e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:33.626937 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a17037fc-dfd7-47eb-95ca-a664ef6a1d84 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:33.627286 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a17037fc-dfd7-47eb-95ca-a664ef6a1d84 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:33.627708 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a17037fc-dfd7-47eb-95ca-a664ef6a1d84 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:33.855260 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-a17037fc-dfd7-47eb-95ca-a664ef6a1d84 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:33.863500 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-a17037fc-dfd7-47eb-95ca-a664ef6a1d84 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.251837 Oct 30 00:49:33.864354 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 108/213] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:33 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:33.867761 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ddf72932-7c3a-4694-9367-57017337413e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:33.876450 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-ddf72932-7c3a-4694-9367-57017337413e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.269175 Oct 30 00:49:33.877288 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 106/214] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:33 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:33.914942 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-fc77964a-eb10-4a09-9696-a948e929e511 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:33.916075 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-fc77964a-eb10-4a09-9696-a948e929e511 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:33.923149 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fc77964a-eb10-4a09-9696-a948e929e511 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:33.923641 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fc77964a-eb10-4a09-9696-a948e929e511 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:33.924061 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fc77964a-eb10-4a09-9696-a948e929e511 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:33.925047 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fc77964a-eb10-4a09-9696-a948e929e511 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:33.925492 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fc77964a-eb10-4a09-9696-a948e929e511 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:33.925905 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fc77964a-eb10-4a09-9696-a948e929e511 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:34.014649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-aab200d5-ba2d-448b-a112-c084fd93c89e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:34.015967 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-aab200d5-ba2d-448b-a112-c084fd93c89e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:34.022422 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aab200d5-ba2d-448b-a112-c084fd93c89e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:34.023140 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aab200d5-ba2d-448b-a112-c084fd93c89e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:34.024339 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aab200d5-ba2d-448b-a112-c084fd93c89e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:34.025844 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aab200d5-ba2d-448b-a112-c084fd93c89e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:34.026719 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aab200d5-ba2d-448b-a112-c084fd93c89e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:34.027146 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aab200d5-ba2d-448b-a112-c084fd93c89e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:34.069382 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-fc77964a-eb10-4a09-9696-a948e929e511 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:34.078689 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-fc77964a-eb10-4a09-9696-a948e929e511 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.168294 Oct 30 00:49:34.079264 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 109/215] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:33 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:34.200299 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-aab200d5-ba2d-448b-a112-c084fd93c89e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:34.212223 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-aab200d5-ba2d-448b-a112-c084fd93c89e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:34.213987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-aab200d5-ba2d-448b-a112-c084fd93c89e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:34.216070 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-aab200d5-ba2d-448b-a112-c084fd93c89e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.205829 Oct 30 00:49:34.216730 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 107/216] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:34 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:34.890344 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-14169dd8-b818-49f2-90ef-1f5819d72464 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:34.890982 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-14169dd8-b818-49f2-90ef-1f5819d72464 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:34.900823 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-14169dd8-b818-49f2-90ef-1f5819d72464 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:34.901229 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1551112a-3f29-41a6-95a1-af1e0bb61feb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:34.901701 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-14169dd8-b818-49f2-90ef-1f5819d72464 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:34.901913 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-14169dd8-b818-49f2-90ef-1f5819d72464 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:34.902028 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1551112a-3f29-41a6-95a1-af1e0bb61feb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:34.902611 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-14169dd8-b818-49f2-90ef-1f5819d72464 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:34.903062 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-14169dd8-b818-49f2-90ef-1f5819d72464 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:34.903480 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-14169dd8-b818-49f2-90ef-1f5819d72464 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:34.909211 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1551112a-3f29-41a6-95a1-af1e0bb61feb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:34.909772 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1551112a-3f29-41a6-95a1-af1e0bb61feb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:34.910270 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1551112a-3f29-41a6-95a1-af1e0bb61feb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:34.911064 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1551112a-3f29-41a6-95a1-af1e0bb61feb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:34.911983 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1551112a-3f29-41a6-95a1-af1e0bb61feb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:34.912804 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1551112a-3f29-41a6-95a1-af1e0bb61feb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:35.101048 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-14169dd8-b818-49f2-90ef-1f5819d72464 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:35.111359 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-14169dd8-b818-49f2-90ef-1f5819d72464 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.225162 Oct 30 00:49:35.111935 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 110/217] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:34 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:35.116514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-01a84acc-3693-4780-b18d-aa5af2857039 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:35.117262 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-01a84acc-3693-4780-b18d-aa5af2857039 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:35.125414 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-01a84acc-3693-4780-b18d-aa5af2857039 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:35.126012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-01a84acc-3693-4780-b18d-aa5af2857039 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:35.126442 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-01a84acc-3693-4780-b18d-aa5af2857039 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:35.127871 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-01a84acc-3693-4780-b18d-aa5af2857039 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:35.128357 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-01a84acc-3693-4780-b18d-aa5af2857039 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:35.128781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-01a84acc-3693-4780-b18d-aa5af2857039 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:35.135470 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1551112a-3f29-41a6-95a1-af1e0bb61feb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:35.144965 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1551112a-3f29-41a6-95a1-af1e0bb61feb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.247408 Oct 30 00:49:35.145716 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 108/218] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:34 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:35.242941 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-aa3b8b38-f7d5-4221-a756-bfe0c76aeaae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:35.243700 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-aa3b8b38-f7d5-4221-a756-bfe0c76aeaae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:35.250850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aa3b8b38-f7d5-4221-a756-bfe0c76aeaae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:35.251514 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aa3b8b38-f7d5-4221-a756-bfe0c76aeaae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:35.252017 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aa3b8b38-f7d5-4221-a756-bfe0c76aeaae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:35.252750 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aa3b8b38-f7d5-4221-a756-bfe0c76aeaae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:35.253409 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aa3b8b38-f7d5-4221-a756-bfe0c76aeaae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:35.253609 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aa3b8b38-f7d5-4221-a756-bfe0c76aeaae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:35.282051 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-01a84acc-3693-4780-b18d-aa5af2857039 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:35.289723 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-01a84acc-3693-4780-b18d-aa5af2857039 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.176656 Oct 30 00:49:35.290281 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 111/219] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:35 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:35.384062 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-aa3b8b38-f7d5-4221-a756-bfe0c76aeaae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:35.392313 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-aa3b8b38-f7d5-4221-a756-bfe0c76aeaae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:35.393776 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-aa3b8b38-f7d5-4221-a756-bfe0c76aeaae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:35.394876 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-aa3b8b38-f7d5-4221-a756-bfe0c76aeaae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.156062 Oct 30 00:49:35.395762 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 109/220] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:35 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:36.135210 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d33b38e9-1f7a-4220-8c4a-7580ce3ab2c0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:36.135759 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-d33b38e9-1f7a-4220-8c4a-7580ce3ab2c0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:36.141882 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d33b38e9-1f7a-4220-8c4a-7580ce3ab2c0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:36.142397 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d33b38e9-1f7a-4220-8c4a-7580ce3ab2c0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:36.142823 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d33b38e9-1f7a-4220-8c4a-7580ce3ab2c0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:36.143500 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d33b38e9-1f7a-4220-8c4a-7580ce3ab2c0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:36.143971 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d33b38e9-1f7a-4220-8c4a-7580ce3ab2c0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:36.144411 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d33b38e9-1f7a-4220-8c4a-7580ce3ab2c0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:36.169285 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-533c7558-97c4-4bb1-a054-98da3032a385 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:36.169884 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-533c7558-97c4-4bb1-a054-98da3032a385 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:36.176434 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-533c7558-97c4-4bb1-a054-98da3032a385 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:36.176911 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-533c7558-97c4-4bb1-a054-98da3032a385 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:36.177340 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-533c7558-97c4-4bb1-a054-98da3032a385 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:36.178020 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-533c7558-97c4-4bb1-a054-98da3032a385 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:36.178465 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-533c7558-97c4-4bb1-a054-98da3032a385 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:36.178881 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-533c7558-97c4-4bb1-a054-98da3032a385 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:36.340731 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-d33b38e9-1f7a-4220-8c4a-7580ce3ab2c0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:36.348007 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-533c7558-97c4-4bb1-a054-98da3032a385 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:36.349372 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-d33b38e9-1f7a-4220-8c4a-7580ce3ab2c0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.217975 Oct 30 00:49:36.350047 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 112/221] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:36 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:36.354413 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-67289745-6c10-4c86-a00c-66af36445b27 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:36.355006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-67289745-6c10-4c86-a00c-66af36445b27 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:36.355894 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-533c7558-97c4-4bb1-a054-98da3032a385 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.190451 Oct 30 00:49:36.356529 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 110/222] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:36 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:36.356839 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=98 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:36.363040 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-67289745-6c10-4c86-a00c-66af36445b27 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:36.363524 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-67289745-6c10-4c86-a00c-66af36445b27 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:36.363958 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-67289745-6c10-4c86-a00c-66af36445b27 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:36.364678 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-67289745-6c10-4c86-a00c-66af36445b27 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:36.365133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-67289745-6c10-4c86-a00c-66af36445b27 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:36.365556 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-67289745-6c10-4c86-a00c-66af36445b27 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:36.425996 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-06c3332d-caf2-417c-b639-cfafc8ba03c4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:36.426963 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-06c3332d-caf2-417c-b639-cfafc8ba03c4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:36.435160 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-06c3332d-caf2-417c-b639-cfafc8ba03c4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:36.436428 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-06c3332d-caf2-417c-b639-cfafc8ba03c4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:36.436872 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-06c3332d-caf2-417c-b639-cfafc8ba03c4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:36.437613 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-06c3332d-caf2-417c-b639-cfafc8ba03c4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:36.438277 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-06c3332d-caf2-417c-b639-cfafc8ba03c4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:36.439167 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-06c3332d-caf2-417c-b639-cfafc8ba03c4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:36.712734 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-67289745-6c10-4c86-a00c-66af36445b27 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:36.722175 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-67289745-6c10-4c86-a00c-66af36445b27 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.371139 Oct 30 00:49:36.722828 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 113/223] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:36 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:36.774662 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-06c3332d-caf2-417c-b639-cfafc8ba03c4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:36.783643 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-06c3332d-caf2-417c-b639-cfafc8ba03c4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:36.785165 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-06c3332d-caf2-417c-b639-cfafc8ba03c4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:36.786262 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-06c3332d-caf2-417c-b639-cfafc8ba03c4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.366577 Oct 30 00:49:36.786825 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 111/224] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:36 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:37.375156 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-1b9a789d-f524-412f-84ae-1677ef520045 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:37.375758 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-1b9a789d-f524-412f-84ae-1677ef520045 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:37.379862 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a6cc2c5a-5b02-4d10-965f-7e5a1eac2b0c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:37.380499 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a6cc2c5a-5b02-4d10-965f-7e5a1eac2b0c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:37.381887 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1b9a789d-f524-412f-84ae-1677ef520045 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:37.382368 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1b9a789d-f524-412f-84ae-1677ef520045 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:37.382800 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1b9a789d-f524-412f-84ae-1677ef520045 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:37.383488 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1b9a789d-f524-412f-84ae-1677ef520045 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:37.383934 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1b9a789d-f524-412f-84ae-1677ef520045 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:37.384377 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1b9a789d-f524-412f-84ae-1677ef520045 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:37.386365 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a6cc2c5a-5b02-4d10-965f-7e5a1eac2b0c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:37.387022 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a6cc2c5a-5b02-4d10-965f-7e5a1eac2b0c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:37.387457 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a6cc2c5a-5b02-4d10-965f-7e5a1eac2b0c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:37.388163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a6cc2c5a-5b02-4d10-965f-7e5a1eac2b0c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:37.388606 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a6cc2c5a-5b02-4d10-965f-7e5a1eac2b0c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:37.389017 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a6cc2c5a-5b02-4d10-965f-7e5a1eac2b0c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:37.572250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-1b9a789d-f524-412f-84ae-1677ef520045 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:37.580773 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-1b9a789d-f524-412f-84ae-1677ef520045 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.210064 Oct 30 00:49:37.581344 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 114/225] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:37 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:37.583761 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a6cc2c5a-5b02-4d10-965f-7e5a1eac2b0c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:37.591613 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a6cc2c5a-5b02-4d10-965f-7e5a1eac2b0c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.215471 Oct 30 00:49:37.592484 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 112/226] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:37 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:37.744980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-6ca0d58d-581a-4ce5-89fb-63d50ee084ae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:37.745811 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-6ca0d58d-581a-4ce5-89fb-63d50ee084ae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:37.753188 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6ca0d58d-581a-4ce5-89fb-63d50ee084ae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:37.753684 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6ca0d58d-581a-4ce5-89fb-63d50ee084ae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:37.754204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6ca0d58d-581a-4ce5-89fb-63d50ee084ae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:37.754946 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6ca0d58d-581a-4ce5-89fb-63d50ee084ae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:37.755466 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6ca0d58d-581a-4ce5-89fb-63d50ee084ae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:37.755988 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6ca0d58d-581a-4ce5-89fb-63d50ee084ae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:37.810935 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-24f578d9-359c-4499-bb11-4130f5fdf3e4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:37.811448 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-24f578d9-359c-4499-bb11-4130f5fdf3e4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:37.818272 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-24f578d9-359c-4499-bb11-4130f5fdf3e4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:37.818753 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-24f578d9-359c-4499-bb11-4130f5fdf3e4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:37.819183 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-24f578d9-359c-4499-bb11-4130f5fdf3e4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:37.819866 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-24f578d9-359c-4499-bb11-4130f5fdf3e4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:37.820357 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-24f578d9-359c-4499-bb11-4130f5fdf3e4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:37.821039 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-24f578d9-359c-4499-bb11-4130f5fdf3e4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:37.836708 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=100 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:37.934532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6ca0d58d-581a-4ce5-89fb-63d50ee084ae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:37.943576 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-6ca0d58d-581a-4ce5-89fb-63d50ee084ae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.202384 Oct 30 00:49:37.944255 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 115/227] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:37 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:37.981010 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-24f578d9-359c-4499-bb11-4130f5fdf3e4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:37.989571 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-24f578d9-359c-4499-bb11-4130f5fdf3e4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:37.991240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-24f578d9-359c-4499-bb11-4130f5fdf3e4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:37.992356 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-24f578d9-359c-4499-bb11-4130f5fdf3e4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.185416 Oct 30 00:49:37.992917 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 113/228] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:37 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:38.602372 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-9a29af58-d5d4-41af-84d9-8f8a97805c78 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:38.602960 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-9a29af58-d5d4-41af-84d9-8f8a97805c78 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:38.610172 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9a29af58-d5d4-41af-84d9-8f8a97805c78 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:38.610648 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9a29af58-d5d4-41af-84d9-8f8a97805c78 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:38.611073 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9a29af58-d5d4-41af-84d9-8f8a97805c78 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:38.611745 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9a29af58-d5d4-41af-84d9-8f8a97805c78 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:38.612220 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9a29af58-d5d4-41af-84d9-8f8a97805c78 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:38.612635 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9a29af58-d5d4-41af-84d9-8f8a97805c78 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:38.614865 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-99cfb3ac-0cdb-4a4b-8de9-50db03209d82 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:38.615493 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-99cfb3ac-0cdb-4a4b-8de9-50db03209d82 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:38.621297 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-99cfb3ac-0cdb-4a4b-8de9-50db03209d82 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:38.621771 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-99cfb3ac-0cdb-4a4b-8de9-50db03209d82 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:38.622201 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-99cfb3ac-0cdb-4a4b-8de9-50db03209d82 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:38.622879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-99cfb3ac-0cdb-4a4b-8de9-50db03209d82 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:38.623332 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-99cfb3ac-0cdb-4a4b-8de9-50db03209d82 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:38.623749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-99cfb3ac-0cdb-4a4b-8de9-50db03209d82 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:38.632394 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=100 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:38.821807 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9a29af58-d5d4-41af-84d9-8f8a97805c78 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:38.832776 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-9a29af58-d5d4-41af-84d9-8f8a97805c78 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.234090 Oct 30 00:49:38.835586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 116/229] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:38 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:38.877586 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-99cfb3ac-0cdb-4a4b-8de9-50db03209d82 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:38.897707 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-99cfb3ac-0cdb-4a4b-8de9-50db03209d82 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.286379 Oct 30 00:49:38.898381 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 114/230] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:38 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:38.966954 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-78ae7de3-1b22-4c23-82a4-fe5fa0d29a9a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:38.967641 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-78ae7de3-1b22-4c23-82a4-fe5fa0d29a9a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:38.974300 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78ae7de3-1b22-4c23-82a4-fe5fa0d29a9a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:38.974778 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78ae7de3-1b22-4c23-82a4-fe5fa0d29a9a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:38.975211 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78ae7de3-1b22-4c23-82a4-fe5fa0d29a9a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:38.975904 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78ae7de3-1b22-4c23-82a4-fe5fa0d29a9a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:38.976380 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78ae7de3-1b22-4c23-82a4-fe5fa0d29a9a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:38.976804 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78ae7de3-1b22-4c23-82a4-fe5fa0d29a9a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:39.018463 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-606206c4-b303-408d-b87b-72484db2b80e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:39.019245 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-606206c4-b303-408d-b87b-72484db2b80e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:39.025510 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-606206c4-b303-408d-b87b-72484db2b80e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:39.025991 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-606206c4-b303-408d-b87b-72484db2b80e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:39.026427 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-606206c4-b303-408d-b87b-72484db2b80e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:39.027114 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-606206c4-b303-408d-b87b-72484db2b80e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:39.027561 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-606206c4-b303-408d-b87b-72484db2b80e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:39.027976 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-606206c4-b303-408d-b87b-72484db2b80e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:39.157182 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-78ae7de3-1b22-4c23-82a4-fe5fa0d29a9a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:39.164817 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-78ae7de3-1b22-4c23-82a4-fe5fa0d29a9a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.201936 Oct 30 00:49:39.165377 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 117/231] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:38 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:39.183677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-606206c4-b303-408d-b87b-72484db2b80e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:39.194023 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-606206c4-b303-408d-b87b-72484db2b80e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:39.195435 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-606206c4-b303-408d-b87b-72484db2b80e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:39.196548 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-606206c4-b303-408d-b87b-72484db2b80e tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.182741 Oct 30 00:49:39.197096 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 115/232] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:39 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:39.857277 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-75b53193-aab2-42be-9781-eefc2082fae3 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:39.857882 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-75b53193-aab2-42be-9781-eefc2082fae3 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:39.865466 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-75b53193-aab2-42be-9781-eefc2082fae3 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:39.865974 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-75b53193-aab2-42be-9781-eefc2082fae3 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:39.866396 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-75b53193-aab2-42be-9781-eefc2082fae3 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:39.867068 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-75b53193-aab2-42be-9781-eefc2082fae3 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:39.867508 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-75b53193-aab2-42be-9781-eefc2082fae3 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:39.867920 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-75b53193-aab2-42be-9781-eefc2082fae3 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:39.932895 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-9e57bf38-f389-431f-857f-414d7a8c1f44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:39.933500 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-9e57bf38-f389-431f-857f-414d7a8c1f44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:39.940637 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9e57bf38-f389-431f-857f-414d7a8c1f44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:39.941195 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9e57bf38-f389-431f-857f-414d7a8c1f44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:39.941691 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9e57bf38-f389-431f-857f-414d7a8c1f44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:39.942444 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9e57bf38-f389-431f-857f-414d7a8c1f44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:39.942976 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9e57bf38-f389-431f-857f-414d7a8c1f44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:39.943458 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9e57bf38-f389-431f-857f-414d7a8c1f44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:40.045642 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-75b53193-aab2-42be-9781-eefc2082fae3 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:40.054177 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-75b53193-aab2-42be-9781-eefc2082fae3 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.200741 Oct 30 00:49:40.054746 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 118/233] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:39 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:40.091245 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-9e57bf38-f389-431f-857f-414d7a8c1f44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:40.099389 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-9e57bf38-f389-431f-857f-414d7a8c1f44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.181457 Oct 30 00:49:40.099939 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 116/234] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:39 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:40.186945 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b5c9e53f-7ede-4e6a-964e-5c18d044f332 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:40.187545 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-b5c9e53f-7ede-4e6a-964e-5c18d044f332 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:40.193728 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5c9e53f-7ede-4e6a-964e-5c18d044f332 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:40.194204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5c9e53f-7ede-4e6a-964e-5c18d044f332 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:40.194632 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5c9e53f-7ede-4e6a-964e-5c18d044f332 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:40.195307 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5c9e53f-7ede-4e6a-964e-5c18d044f332 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:40.195753 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5c9e53f-7ede-4e6a-964e-5c18d044f332 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:40.196193 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5c9e53f-7ede-4e6a-964e-5c18d044f332 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:40.222914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-fbf3088d-f5be-4fa2-925f-2e51fa9dd825 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:40.223517 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-fbf3088d-f5be-4fa2-925f-2e51fa9dd825 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:40.229405 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbf3088d-f5be-4fa2-925f-2e51fa9dd825 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:40.229888 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbf3088d-f5be-4fa2-925f-2e51fa9dd825 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:40.230325 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbf3088d-f5be-4fa2-925f-2e51fa9dd825 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:40.231018 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbf3088d-f5be-4fa2-925f-2e51fa9dd825 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:40.231466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbf3088d-f5be-4fa2-925f-2e51fa9dd825 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:40.231890 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbf3088d-f5be-4fa2-925f-2e51fa9dd825 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:40.379124 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b5c9e53f-7ede-4e6a-964e-5c18d044f332 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:40.386944 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b5c9e53f-7ede-4e6a-964e-5c18d044f332 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.203734 Oct 30 00:49:40.387519 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 119/235] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:40 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:40.402597 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fbf3088d-f5be-4fa2-925f-2e51fa9dd825 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:40.411302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fbf3088d-f5be-4fa2-925f-2e51fa9dd825 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:40.412767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fbf3088d-f5be-4fa2-925f-2e51fa9dd825 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:40.413854 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-fbf3088d-f5be-4fa2-925f-2e51fa9dd825 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.194798 Oct 30 00:49:40.414394 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 117/236] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:40 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:41.076789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-92a6c8c5-3fc8-4d67-86c9-56780d52a998 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:41.078685 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-92a6c8c5-3fc8-4d67-86c9-56780d52a998 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:41.084607 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-92a6c8c5-3fc8-4d67-86c9-56780d52a998 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:41.085083 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-92a6c8c5-3fc8-4d67-86c9-56780d52a998 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:41.085507 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-92a6c8c5-3fc8-4d67-86c9-56780d52a998 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:41.086184 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-92a6c8c5-3fc8-4d67-86c9-56780d52a998 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:41.086628 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-92a6c8c5-3fc8-4d67-86c9-56780d52a998 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:41.087045 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-92a6c8c5-3fc8-4d67-86c9-56780d52a998 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:41.122685 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-b5050795-8a98-410d-b3e9-0971ef08892d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:41.123392 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-b5050795-8a98-410d-b3e9-0971ef08892d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:41.130222 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b5050795-8a98-410d-b3e9-0971ef08892d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:41.130783 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b5050795-8a98-410d-b3e9-0971ef08892d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:41.131286 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b5050795-8a98-410d-b3e9-0971ef08892d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:41.132049 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b5050795-8a98-410d-b3e9-0971ef08892d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:41.132589 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b5050795-8a98-410d-b3e9-0971ef08892d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:41.133079 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b5050795-8a98-410d-b3e9-0971ef08892d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:41.267654 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-92a6c8c5-3fc8-4d67-86c9-56780d52a998 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:41.275301 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-92a6c8c5-3fc8-4d67-86c9-56780d52a998 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.202334 Oct 30 00:49:41.275951 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 120/237] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:41 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:41.296784 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-b5050795-8a98-410d-b3e9-0971ef08892d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:41.304277 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-b5050795-8a98-410d-b3e9-0971ef08892d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.185352 Oct 30 00:49:41.304822 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 118/238] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:41 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:41.410650 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-64ebca1c-ea9c-47d9-ae08-d2e1ccb27d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:41.411252 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-64ebca1c-ea9c-47d9-ae08-d2e1ccb27d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:41.417341 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64ebca1c-ea9c-47d9-ae08-d2e1ccb27d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:41.417820 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64ebca1c-ea9c-47d9-ae08-d2e1ccb27d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:41.418249 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64ebca1c-ea9c-47d9-ae08-d2e1ccb27d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:41.418929 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64ebca1c-ea9c-47d9-ae08-d2e1ccb27d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:41.419378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64ebca1c-ea9c-47d9-ae08-d2e1ccb27d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:41.419825 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64ebca1c-ea9c-47d9-ae08-d2e1ccb27d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:41.438675 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a1a59e92-6bce-45e1-b3c2-0e928195c41d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:41.439530 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a1a59e92-6bce-45e1-b3c2-0e928195c41d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:41.445497 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a1a59e92-6bce-45e1-b3c2-0e928195c41d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:41.445968 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a1a59e92-6bce-45e1-b3c2-0e928195c41d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:41.446415 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a1a59e92-6bce-45e1-b3c2-0e928195c41d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:41.447089 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a1a59e92-6bce-45e1-b3c2-0e928195c41d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:41.447529 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a1a59e92-6bce-45e1-b3c2-0e928195c41d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:41.447939 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a1a59e92-6bce-45e1-b3c2-0e928195c41d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:41.616529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-64ebca1c-ea9c-47d9-ae08-d2e1ccb27d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:41.620372 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a1a59e92-6bce-45e1-b3c2-0e928195c41d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:41.624370 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-64ebca1c-ea9c-47d9-ae08-d2e1ccb27d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.217255 Oct 30 00:49:41.624945 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 121/239] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:41 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:41.628418 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a1a59e92-6bce-45e1-b3c2-0e928195c41d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:41.629831 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a1a59e92-6bce-45e1-b3c2-0e928195c41d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:41.630910 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a1a59e92-6bce-45e1-b3c2-0e928195c41d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.196048 Oct 30 00:49:41.631447 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 119/240] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:41 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:42.298173 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-9e1a11ba-d104-4c60-b631-455bb887a638 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:42.298710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-9e1a11ba-d104-4c60-b631-455bb887a638 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:42.304569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9e1a11ba-d104-4c60-b631-455bb887a638 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:42.305037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9e1a11ba-d104-4c60-b631-455bb887a638 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:42.305460 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9e1a11ba-d104-4c60-b631-455bb887a638 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:42.306127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9e1a11ba-d104-4c60-b631-455bb887a638 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:42.306567 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9e1a11ba-d104-4c60-b631-455bb887a638 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:42.306977 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9e1a11ba-d104-4c60-b631-455bb887a638 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:42.326474 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-588ed4a5-5c4f-42b7-b8ba-5944a6c01a86 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:42.328368 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-588ed4a5-5c4f-42b7-b8ba-5944a6c01a86 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:42.334190 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-588ed4a5-5c4f-42b7-b8ba-5944a6c01a86 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:42.334670 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-588ed4a5-5c4f-42b7-b8ba-5944a6c01a86 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:42.335153 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-588ed4a5-5c4f-42b7-b8ba-5944a6c01a86 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:42.335842 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-588ed4a5-5c4f-42b7-b8ba-5944a6c01a86 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:42.336319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-588ed4a5-5c4f-42b7-b8ba-5944a6c01a86 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:42.336733 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-588ed4a5-5c4f-42b7-b8ba-5944a6c01a86 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:42.497956 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9e1a11ba-d104-4c60-b631-455bb887a638 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:42.506025 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-9e1a11ba-d104-4c60-b631-455bb887a638 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.211690 Oct 30 00:49:42.506722 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 122/241] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:42 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:42.508897 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-588ed4a5-5c4f-42b7-b8ba-5944a6c01a86 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:42.517030 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-588ed4a5-5c4f-42b7-b8ba-5944a6c01a86 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.194296 Oct 30 00:49:42.517581 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 120/242] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:42 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:42.646909 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-262c380a-8dc0-49ad-b786-9109ee846fa6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:42.647550 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-262c380a-8dc0-49ad-b786-9109ee846fa6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:42.653504 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-262c380a-8dc0-49ad-b786-9109ee846fa6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:42.653981 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-262c380a-8dc0-49ad-b786-9109ee846fa6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:42.654455 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-262c380a-8dc0-49ad-b786-9109ee846fa6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:42.654563 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-fb462090-da25-4d0d-ad62-e8f935eb16d1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:42.655048 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-fb462090-da25-4d0d-ad62-e8f935eb16d1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:42.655165 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-262c380a-8dc0-49ad-b786-9109ee846fa6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:42.656287 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-262c380a-8dc0-49ad-b786-9109ee846fa6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:42.656719 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-262c380a-8dc0-49ad-b786-9109ee846fa6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:42.661623 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb462090-da25-4d0d-ad62-e8f935eb16d1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:42.662093 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb462090-da25-4d0d-ad62-e8f935eb16d1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:42.662517 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb462090-da25-4d0d-ad62-e8f935eb16d1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:42.663186 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb462090-da25-4d0d-ad62-e8f935eb16d1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:42.663630 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb462090-da25-4d0d-ad62-e8f935eb16d1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:42.664041 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb462090-da25-4d0d-ad62-e8f935eb16d1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:42.845906 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-262c380a-8dc0-49ad-b786-9109ee846fa6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:42.853871 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-262c380a-8dc0-49ad-b786-9109ee846fa6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.210749 Oct 30 00:49:42.854451 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 123/243] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:42 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:42.856933 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fb462090-da25-4d0d-ad62-e8f935eb16d1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:42.866089 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fb462090-da25-4d0d-ad62-e8f935eb16d1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:42.867669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fb462090-da25-4d0d-ad62-e8f935eb16d1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:42.868857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-fb462090-da25-4d0d-ad62-e8f935eb16d1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.218158 Oct 30 00:49:42.869405 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 121/244] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:42 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:43.530128 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-26ae9ed0-5889-4b2b-8f9d-27beb7a71b5f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:43.530785 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-26ae9ed0-5889-4b2b-8f9d-27beb7a71b5f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:43.536714 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-26ae9ed0-5889-4b2b-8f9d-27beb7a71b5f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:43.537191 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-26ae9ed0-5889-4b2b-8f9d-27beb7a71b5f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:43.537616 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-26ae9ed0-5889-4b2b-8f9d-27beb7a71b5f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:43.538310 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-26ae9ed0-5889-4b2b-8f9d-27beb7a71b5f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:43.538752 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-26ae9ed0-5889-4b2b-8f9d-27beb7a71b5f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:43.539164 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-26ae9ed0-5889-4b2b-8f9d-27beb7a71b5f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:43.542256 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-29a5998f-ae75-4d41-ba0c-58e5296a9a30 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:43.543767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-29a5998f-ae75-4d41-ba0c-58e5296a9a30 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:43.552549 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-29a5998f-ae75-4d41-ba0c-58e5296a9a30 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:43.553054 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-29a5998f-ae75-4d41-ba0c-58e5296a9a30 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:43.553776 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-29a5998f-ae75-4d41-ba0c-58e5296a9a30 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:43.554486 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-29a5998f-ae75-4d41-ba0c-58e5296a9a30 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:43.555582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-29a5998f-ae75-4d41-ba0c-58e5296a9a30 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:43.556217 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-29a5998f-ae75-4d41-ba0c-58e5296a9a30 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:43.731341 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-26ae9ed0-5889-4b2b-8f9d-27beb7a71b5f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:43.739857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-26ae9ed0-5889-4b2b-8f9d-27beb7a71b5f tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.213309 Oct 30 00:49:43.740204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 124/245] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:43 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:43.755103 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-29a5998f-ae75-4d41-ba0c-58e5296a9a30 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:43.762733 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-29a5998f-ae75-4d41-ba0c-58e5296a9a30 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.225829 Oct 30 00:49:43.763370 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 122/246] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:43 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:43.876701 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-6e9e4a2c-a315-4fee-ab2d-fb5dc71c0a92 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:43.877309 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-6e9e4a2c-a315-4fee-ab2d-fb5dc71c0a92 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:43.883525 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6e9e4a2c-a315-4fee-ab2d-fb5dc71c0a92 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:43.884002 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6e9e4a2c-a315-4fee-ab2d-fb5dc71c0a92 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:43.884487 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6e9e4a2c-a315-4fee-ab2d-fb5dc71c0a92 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:43.885197 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6e9e4a2c-a315-4fee-ab2d-fb5dc71c0a92 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:43.885645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6e9e4a2c-a315-4fee-ab2d-fb5dc71c0a92 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:43.886061 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6e9e4a2c-a315-4fee-ab2d-fb5dc71c0a92 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:43.894700 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-21bfe8b0-ef20-4873-becf-6ac9c81f177a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:43.895327 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-21bfe8b0-ef20-4873-becf-6ac9c81f177a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:43.901176 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-21bfe8b0-ef20-4873-becf-6ac9c81f177a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:43.901638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-21bfe8b0-ef20-4873-becf-6ac9c81f177a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:43.902089 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-21bfe8b0-ef20-4873-becf-6ac9c81f177a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:43.902768 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-21bfe8b0-ef20-4873-becf-6ac9c81f177a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:43.903204 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-21bfe8b0-ef20-4873-becf-6ac9c81f177a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:43.903613 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-21bfe8b0-ef20-4873-becf-6ac9c81f177a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:44.091903 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6e9e4a2c-a315-4fee-ab2d-fb5dc71c0a92 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:44.110817 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-21bfe8b0-ef20-4873-becf-6ac9c81f177a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:44.121179 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-6e9e4a2c-a315-4fee-ab2d-fb5dc71c0a92 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.234529 Oct 30 00:49:44.122224 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 125/247] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:43 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:44.123531 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-21bfe8b0-ef20-4873-becf-6ac9c81f177a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:44.125502 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-21bfe8b0-ef20-4873-becf-6ac9c81f177a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:44.126824 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-21bfe8b0-ef20-4873-becf-6ac9c81f177a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.236160 Oct 30 00:49:44.140296 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 123/248] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:43 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:44.269544 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-1c9c4c1d-2fd8-49ba-b9b2-f19249a54af7 req-b8c2e114-bd25-4a77-9e16-14b58ef1c8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc267534-c882-4793-a8f9-17df60c7fa64", "name": "network-vif-plugged", "status": "completed", "tag": "7ec2e88e-6952-48c2-a06d-48ad36a8fe11"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:49:44.279208 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-1c9c4c1d-2fd8-49ba-b9b2-f19249a54af7 req-b8c2e114-bd25-4a77-9e16-14b58ef1c8d8 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:44.279960 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-1c9c4c1d-2fd8-49ba-b9b2-f19249a54af7 req-b8c2e114-bd25-4a77-9e16-14b58ef1c8d8 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:44.280501 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-1c9c4c1d-2fd8-49ba-b9b2-f19249a54af7 req-b8c2e114-bd25-4a77-9e16-14b58ef1c8d8 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:44.292135 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-1c9c4c1d-2fd8-49ba-b9b2-f19249a54af7 req-b8c2e114-bd25-4a77-9e16-14b58ef1c8d8 service nova] Creating event network-vif-plugged:7ec2e88e-6952-48c2-a06d-48ad36a8fe11 for instance fc267534-c882-4793-a8f9-17df60c7fa64 on hv-cinder-86149 Oct 30 00:49:44.298088 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-1c9c4c1d-2fd8-49ba-b9b2-f19249a54af7 req-b8c2e114-bd25-4a77-9e16-14b58ef1c8d8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033100 Oct 30 00:49:44.299085 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 126/249] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:49:44.761383 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-4d9c8e41-485b-4fdd-bbb5-6501ba11e4ed tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:44.761984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-4d9c8e41-485b-4fdd-bbb5-6501ba11e4ed tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:44.768797 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4d9c8e41-485b-4fdd-bbb5-6501ba11e4ed tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:44.769287 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4d9c8e41-485b-4fdd-bbb5-6501ba11e4ed tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:44.769779 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4d9c8e41-485b-4fdd-bbb5-6501ba11e4ed tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:44.770465 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4d9c8e41-485b-4fdd-bbb5-6501ba11e4ed tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:44.770945 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4d9c8e41-485b-4fdd-bbb5-6501ba11e4ed tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:44.771715 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4d9c8e41-485b-4fdd-bbb5-6501ba11e4ed tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:44.787977 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-a8292a64-0f8e-4b9d-b09d-ea696511d0f7 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:44.789874 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-a8292a64-0f8e-4b9d-b09d-ea696511d0f7 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:44.805027 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a8292a64-0f8e-4b9d-b09d-ea696511d0f7 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:44.805509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a8292a64-0f8e-4b9d-b09d-ea696511d0f7 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:44.806168 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a8292a64-0f8e-4b9d-b09d-ea696511d0f7 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:44.807073 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a8292a64-0f8e-4b9d-b09d-ea696511d0f7 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:44.807715 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a8292a64-0f8e-4b9d-b09d-ea696511d0f7 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:44.808559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a8292a64-0f8e-4b9d-b09d-ea696511d0f7 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:44.969306 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-4d9c8e41-485b-4fdd-bbb5-6501ba11e4ed tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:44.976917 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-4d9c8e41-485b-4fdd-bbb5-6501ba11e4ed tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.219291 Oct 30 00:49:44.977479 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 124/250] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:44 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:44.992589 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-a8292a64-0f8e-4b9d-b09d-ea696511d0f7 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:45.002050 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-a8292a64-0f8e-4b9d-b09d-ea696511d0f7 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.218693 Oct 30 00:49:45.002598 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 127/251] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:44 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:45.146521 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-57225c6c-2603-4f1f-a975-88b9076ab496 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:45.147192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-57225c6c-2603-4f1f-a975-88b9076ab496 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:45.153067 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f1475e89-cd8d-45be-b566-315509ab8ea6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:45.153465 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-57225c6c-2603-4f1f-a975-88b9076ab496 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:45.153666 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-f1475e89-cd8d-45be-b566-315509ab8ea6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:45.153933 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-57225c6c-2603-4f1f-a975-88b9076ab496 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:45.154357 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-57225c6c-2603-4f1f-a975-88b9076ab496 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:45.155029 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-57225c6c-2603-4f1f-a975-88b9076ab496 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:45.155503 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-57225c6c-2603-4f1f-a975-88b9076ab496 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:45.155967 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-57225c6c-2603-4f1f-a975-88b9076ab496 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:45.159850 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f1475e89-cd8d-45be-b566-315509ab8ea6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:45.160357 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f1475e89-cd8d-45be-b566-315509ab8ea6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:45.160793 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f1475e89-cd8d-45be-b566-315509ab8ea6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:45.161476 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f1475e89-cd8d-45be-b566-315509ab8ea6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:45.161922 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f1475e89-cd8d-45be-b566-315509ab8ea6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:45.162401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f1475e89-cd8d-45be-b566-315509ab8ea6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:45.350258 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-57225c6c-2603-4f1f-a975-88b9076ab496 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:45.357553 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-f1475e89-cd8d-45be-b566-315509ab8ea6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:45.357880 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-57225c6c-2603-4f1f-a975-88b9076ab496 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.215286 Oct 30 00:49:45.360299 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 125/252] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:45 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:45.367170 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-f1475e89-cd8d-45be-b566-315509ab8ea6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:45.368668 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-f1475e89-cd8d-45be-b566-315509ab8ea6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:45.369748 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-f1475e89-cd8d-45be-b566-315509ab8ea6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.220468 Oct 30 00:49:45.370290 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 128/253] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:45 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:46.001371 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3eb869e2-d58f-4459-8e15-57a009b68a99 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:46.001977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-3eb869e2-d58f-4459-8e15-57a009b68a99 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:46.003869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=98 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:46.008999 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3eb869e2-d58f-4459-8e15-57a009b68a99 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:46.009477 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3eb869e2-d58f-4459-8e15-57a009b68a99 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:46.009906 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3eb869e2-d58f-4459-8e15-57a009b68a99 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:46.010586 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3eb869e2-d58f-4459-8e15-57a009b68a99 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:46.011032 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3eb869e2-d58f-4459-8e15-57a009b68a99 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:46.011449 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3eb869e2-d58f-4459-8e15-57a009b68a99 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:46.026029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c7cf2ca8-fd81-4adf-ae24-405fa389e538 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:46.026758 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c7cf2ca8-fd81-4adf-ae24-405fa389e538 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:46.033111 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c7cf2ca8-fd81-4adf-ae24-405fa389e538 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:46.033588 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c7cf2ca8-fd81-4adf-ae24-405fa389e538 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:46.034018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c7cf2ca8-fd81-4adf-ae24-405fa389e538 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:46.034698 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c7cf2ca8-fd81-4adf-ae24-405fa389e538 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:46.035143 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c7cf2ca8-fd81-4adf-ae24-405fa389e538 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:46.035557 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c7cf2ca8-fd81-4adf-ae24-405fa389e538 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:46.208265 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3eb869e2-d58f-4459-8e15-57a009b68a99 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:46.212312 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c7cf2ca8-fd81-4adf-ae24-405fa389e538 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:46.216208 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-3eb869e2-d58f-4459-8e15-57a009b68a99 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.219677 Oct 30 00:49:46.216874 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 126/254] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:45 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:46.220856 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c7cf2ca8-fd81-4adf-ae24-405fa389e538 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.198872 Oct 30 00:49:46.221559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 129/255] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:46 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:46.381275 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-17b1f4cb-ee78-4bbd-851c-6cec868bbf7b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:46.381805 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-17b1f4cb-ee78-4bbd-851c-6cec868bbf7b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:46.387691 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-17b1f4cb-ee78-4bbd-851c-6cec868bbf7b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:46.388231 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-17b1f4cb-ee78-4bbd-851c-6cec868bbf7b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:46.388661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-17b1f4cb-ee78-4bbd-851c-6cec868bbf7b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:46.390063 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-17b1f4cb-ee78-4bbd-851c-6cec868bbf7b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:46.390503 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-17b1f4cb-ee78-4bbd-851c-6cec868bbf7b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:46.390930 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-17b1f4cb-ee78-4bbd-851c-6cec868bbf7b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:46.395613 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-5ae1d508-6f14-4faf-895a-066f910b3ad3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:46.396310 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-5ae1d508-6f14-4faf-895a-066f910b3ad3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:46.402043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5ae1d508-6f14-4faf-895a-066f910b3ad3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:46.402516 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5ae1d508-6f14-4faf-895a-066f910b3ad3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:46.402939 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5ae1d508-6f14-4faf-895a-066f910b3ad3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:46.403610 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5ae1d508-6f14-4faf-895a-066f910b3ad3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:46.404057 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5ae1d508-6f14-4faf-895a-066f910b3ad3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:46.404492 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5ae1d508-6f14-4faf-895a-066f910b3ad3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:46.582807 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-17b1f4cb-ee78-4bbd-851c-6cec868bbf7b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:46.586527 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-5ae1d508-6f14-4faf-895a-066f910b3ad3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:46.590427 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-17b1f4cb-ee78-4bbd-851c-6cec868bbf7b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.213005 Oct 30 00:49:46.591011 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 127/256] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:46 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:46.595028 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-5ae1d508-6f14-4faf-895a-066f910b3ad3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:46.596473 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-5ae1d508-6f14-4faf-895a-066f910b3ad3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:46.597550 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-5ae1d508-6f14-4faf-895a-066f910b3ad3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.205768 Oct 30 00:49:46.598122 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 130/257] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:46 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:49:47.239492 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-6fdec673-774a-486d-a026-7c8926442e9e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:47.240206 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-6fdec673-774a-486d-a026-7c8926442e9e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:47.243393 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-1ac59f70-05b1-4c3d-b195-22b4e78a3f6b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:47.244016 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-1ac59f70-05b1-4c3d-b195-22b4e78a3f6b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:47.246074 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6fdec673-774a-486d-a026-7c8926442e9e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:47.246549 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6fdec673-774a-486d-a026-7c8926442e9e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:47.246967 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6fdec673-774a-486d-a026-7c8926442e9e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:47.247641 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6fdec673-774a-486d-a026-7c8926442e9e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:47.248113 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6fdec673-774a-486d-a026-7c8926442e9e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:47.248513 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6fdec673-774a-486d-a026-7c8926442e9e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:47.249868 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1ac59f70-05b1-4c3d-b195-22b4e78a3f6b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:47.250459 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1ac59f70-05b1-4c3d-b195-22b4e78a3f6b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:47.250886 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1ac59f70-05b1-4c3d-b195-22b4e78a3f6b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:47.251557 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1ac59f70-05b1-4c3d-b195-22b4e78a3f6b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:47.251997 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1ac59f70-05b1-4c3d-b195-22b4e78a3f6b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:47.252450 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1ac59f70-05b1-4c3d-b195-22b4e78a3f6b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:47.447020 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-6fdec673-774a-486d-a026-7c8926442e9e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:47.450373 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-1ac59f70-05b1-4c3d-b195-22b4e78a3f6b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:47.455699 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-6fdec673-774a-486d-a026-7c8926442e9e tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.219473 Oct 30 00:49:47.456294 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 128/258] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:47 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:47.460459 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-1ac59f70-05b1-4c3d-b195-22b4e78a3f6b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.220447 Oct 30 00:49:47.464364 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 131/259] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:47 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:47.613510 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-635657ea-35c4-4480-9a08-b341e8354edd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:47.614104 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-635657ea-35c4-4480-9a08-b341e8354edd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:47.620273 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-635657ea-35c4-4480-9a08-b341e8354edd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:47.620755 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-635657ea-35c4-4480-9a08-b341e8354edd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:47.621214 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-635657ea-35c4-4480-9a08-b341e8354edd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:47.621896 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-635657ea-35c4-4480-9a08-b341e8354edd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:47.622336 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-a284de69-1a7a-47b4-a921-ae301edfaf70 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:47.622452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-635657ea-35c4-4480-9a08-b341e8354edd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:47.622753 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-635657ea-35c4-4480-9a08-b341e8354edd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:47.622935 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-a284de69-1a7a-47b4-a921-ae301edfaf70 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:47.629027 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a284de69-1a7a-47b4-a921-ae301edfaf70 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:47.629503 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a284de69-1a7a-47b4-a921-ae301edfaf70 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:47.629923 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a284de69-1a7a-47b4-a921-ae301edfaf70 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:47.630600 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a284de69-1a7a-47b4-a921-ae301edfaf70 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:47.631040 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a284de69-1a7a-47b4-a921-ae301edfaf70 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:47.631454 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a284de69-1a7a-47b4-a921-ae301edfaf70 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:47.813437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-635657ea-35c4-4480-9a08-b341e8354edd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:47.820489 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-a284de69-1a7a-47b4-a921-ae301edfaf70 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:47.821503 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-635657ea-35c4-4480-9a08-b341e8354edd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.211899 Oct 30 00:49:47.822071 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 129/260] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:47 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:47.829252 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-a284de69-1a7a-47b4-a921-ae301edfaf70 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:47.830692 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-a284de69-1a7a-47b4-a921-ae301edfaf70 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:47.831789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-a284de69-1a7a-47b4-a921-ae301edfaf70 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.213247 Oct 30 00:49:47.832363 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 132/261] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:47 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:48.479673 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-65d7d34e-65aa-4238-87da-afd645527ce0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:48.480297 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-65d7d34e-65aa-4238-87da-afd645527ce0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:48.483990 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c71c6573-7a16-4381-a38c-3156747c5529 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:48.484706 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c71c6573-7a16-4381-a38c-3156747c5529 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:48.487248 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-65d7d34e-65aa-4238-87da-afd645527ce0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:48.487725 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-65d7d34e-65aa-4238-87da-afd645527ce0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:48.488169 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-65d7d34e-65aa-4238-87da-afd645527ce0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:48.488849 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-65d7d34e-65aa-4238-87da-afd645527ce0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:48.489291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-65d7d34e-65aa-4238-87da-afd645527ce0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:48.489702 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-65d7d34e-65aa-4238-87da-afd645527ce0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:48.490551 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c71c6573-7a16-4381-a38c-3156747c5529 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:48.491031 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c71c6573-7a16-4381-a38c-3156747c5529 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:48.491491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c71c6573-7a16-4381-a38c-3156747c5529 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:48.492194 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c71c6573-7a16-4381-a38c-3156747c5529 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:48.492302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=100 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:48.492701 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c71c6573-7a16-4381-a38c-3156747c5529 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:48.493126 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c71c6573-7a16-4381-a38c-3156747c5529 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:48.868004 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-65d7d34e-65aa-4238-87da-afd645527ce0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:48.872161 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c71c6573-7a16-4381-a38c-3156747c5529 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:48.876714 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=100 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:49:48.877743 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-65d7d34e-65aa-4238-87da-afd645527ce0 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.401658 Oct 30 00:49:48.878454 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 130/262] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:48 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:48.882301 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c71c6573-7a16-4381-a38c-3156747c5529 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.402498 Oct 30 00:49:48.892103 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 133/263] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:48 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:48.892745 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-783b3abd-2f85-4acd-b71a-c3d0277f08b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:48.892745 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-783b3abd-2f85-4acd-b71a-c3d0277f08b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:48.892910 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-dbd9d4e3-664f-429c-91d1-cf9a84b560ad tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:48.892910 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-dbd9d4e3-664f-429c-91d1-cf9a84b560ad tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:48.902499 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-783b3abd-2f85-4acd-b71a-c3d0277f08b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:48.902993 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-783b3abd-2f85-4acd-b71a-c3d0277f08b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:48.903426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-783b3abd-2f85-4acd-b71a-c3d0277f08b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:48.903954 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-dbd9d4e3-664f-429c-91d1-cf9a84b560ad tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:48.904158 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-783b3abd-2f85-4acd-b71a-c3d0277f08b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:48.904474 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-dbd9d4e3-664f-429c-91d1-cf9a84b560ad tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:48.904572 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-783b3abd-2f85-4acd-b71a-c3d0277f08b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:48.904937 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-dbd9d4e3-664f-429c-91d1-cf9a84b560ad tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:48.905088 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-783b3abd-2f85-4acd-b71a-c3d0277f08b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:48.905628 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-dbd9d4e3-664f-429c-91d1-cf9a84b560ad tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:48.906082 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-dbd9d4e3-664f-429c-91d1-cf9a84b560ad tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:48.906500 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-dbd9d4e3-664f-429c-91d1-cf9a84b560ad tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:49.106928 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-dbd9d4e3-664f-429c-91d1-cf9a84b560ad tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:49.111175 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-783b3abd-2f85-4acd-b71a-c3d0277f08b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:49.115140 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-dbd9d4e3-664f-429c-91d1-cf9a84b560ad tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:49.116605 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-dbd9d4e3-664f-429c-91d1-cf9a84b560ad tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:49.117707 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-dbd9d4e3-664f-429c-91d1-cf9a84b560ad tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.233920 Oct 30 00:49:49.118258 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 134/264] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:48 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:49:49.119037 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-783b3abd-2f85-4acd-b71a-c3d0277f08b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.239516 Oct 30 00:49:49.119618 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 131/265] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:48 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:49.901744 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c0b4433e-3aff-4d4f-82c5-4fecd15852d8 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:49.902514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c0b4433e-3aff-4d4f-82c5-4fecd15852d8 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:49.907888 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-49a3efc5-e24c-47a6-ad65-5d03352b6399 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:49.908516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-49a3efc5-e24c-47a6-ad65-5d03352b6399 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:49.909453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c0b4433e-3aff-4d4f-82c5-4fecd15852d8 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:49.909934 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c0b4433e-3aff-4d4f-82c5-4fecd15852d8 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:49.910359 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c0b4433e-3aff-4d4f-82c5-4fecd15852d8 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:49.911431 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c0b4433e-3aff-4d4f-82c5-4fecd15852d8 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:49.911550 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c0b4433e-3aff-4d4f-82c5-4fecd15852d8 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:49.911943 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c0b4433e-3aff-4d4f-82c5-4fecd15852d8 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:49.914487 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-49a3efc5-e24c-47a6-ad65-5d03352b6399 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:49.915023 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-49a3efc5-e24c-47a6-ad65-5d03352b6399 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:49.915421 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-49a3efc5-e24c-47a6-ad65-5d03352b6399 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:49.916145 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-49a3efc5-e24c-47a6-ad65-5d03352b6399 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:49.916610 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-49a3efc5-e24c-47a6-ad65-5d03352b6399 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:49.917021 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-49a3efc5-e24c-47a6-ad65-5d03352b6399 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:50.117982 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c0b4433e-3aff-4d4f-82c5-4fecd15852d8 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:50.122018 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-49a3efc5-e24c-47a6-ad65-5d03352b6399 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:50.127575 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c0b4433e-3aff-4d4f-82c5-4fecd15852d8 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.229522 Oct 30 00:49:50.128350 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 135/266] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:49 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:50.130216 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-49a3efc5-e24c-47a6-ad65-5d03352b6399 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.226599 Oct 30 00:49:50.130767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 132/267] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:49 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:50.145429 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-a42d10d0-d3f6-46bc-962c-52816bb065ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:50.146341 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-a42d10d0-d3f6-46bc-962c-52816bb065ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:50.149516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-634d2f35-22a7-4780-a49e-8e6e0d887f55 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:50.150254 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-634d2f35-22a7-4780-a49e-8e6e0d887f55 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:50.153577 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a42d10d0-d3f6-46bc-962c-52816bb065ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:50.154059 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a42d10d0-d3f6-46bc-962c-52816bb065ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:50.154610 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a42d10d0-d3f6-46bc-962c-52816bb065ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:50.155443 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a42d10d0-d3f6-46bc-962c-52816bb065ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:50.156106 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a42d10d0-d3f6-46bc-962c-52816bb065ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:50.156739 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a42d10d0-d3f6-46bc-962c-52816bb065ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:50.157353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-634d2f35-22a7-4780-a49e-8e6e0d887f55 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:50.157833 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-634d2f35-22a7-4780-a49e-8e6e0d887f55 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:50.158263 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-634d2f35-22a7-4780-a49e-8e6e0d887f55 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:50.158956 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-634d2f35-22a7-4780-a49e-8e6e0d887f55 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:50.159406 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-634d2f35-22a7-4780-a49e-8e6e0d887f55 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:50.159852 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-634d2f35-22a7-4780-a49e-8e6e0d887f55 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:50.354565 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-a42d10d0-d3f6-46bc-962c-52816bb065ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:50.358922 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-634d2f35-22a7-4780-a49e-8e6e0d887f55 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:50.363464 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-a42d10d0-d3f6-46bc-962c-52816bb065ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:50.364959 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-a42d10d0-d3f6-46bc-962c-52816bb065ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:50.366065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-a42d10d0-d3f6-46bc-962c-52816bb065ed tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.224783 Oct 30 00:49:50.366619 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 136/268] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:50 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:49:50.366983 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-634d2f35-22a7-4780-a49e-8e6e0d887f55 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.221480 Oct 30 00:49:50.367609 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 133/269] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:50 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:51.151652 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-90f38ea9-ae7e-4183-85a8-39dfde4f338b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:51.152322 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-90f38ea9-ae7e-4183-85a8-39dfde4f338b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:51.154855 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-189c6924-ddad-4789-a760-889ab12464e4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:51.156270 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-189c6924-ddad-4789-a760-889ab12464e4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:51.161855 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-90f38ea9-ae7e-4183-85a8-39dfde4f338b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:51.163310 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-90f38ea9-ae7e-4183-85a8-39dfde4f338b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:51.163814 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-90f38ea9-ae7e-4183-85a8-39dfde4f338b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:51.164634 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-189c6924-ddad-4789-a760-889ab12464e4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:51.165154 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-189c6924-ddad-4789-a760-889ab12464e4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:51.165470 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-90f38ea9-ae7e-4183-85a8-39dfde4f338b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:51.166046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-90f38ea9-ae7e-4183-85a8-39dfde4f338b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:51.166175 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-189c6924-ddad-4789-a760-889ab12464e4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:51.166648 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-90f38ea9-ae7e-4183-85a8-39dfde4f338b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:51.167129 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-189c6924-ddad-4789-a760-889ab12464e4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:51.168260 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-189c6924-ddad-4789-a760-889ab12464e4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:51.168909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-189c6924-ddad-4789-a760-889ab12464e4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:51.363335 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-90f38ea9-ae7e-4183-85a8-39dfde4f338b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:51.371233 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-90f38ea9-ae7e-4183-85a8-39dfde4f338b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.224180 Oct 30 00:49:51.371666 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 137/270] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:51 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:51.392848 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-a838687e-763a-47b1-b264-9dce670abadb tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:51.393457 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-a838687e-763a-47b1-b264-9dce670abadb tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:51.400379 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a838687e-763a-47b1-b264-9dce670abadb tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:51.400869 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a838687e-763a-47b1-b264-9dce670abadb tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:51.401303 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a838687e-763a-47b1-b264-9dce670abadb tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:51.401998 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a838687e-763a-47b1-b264-9dce670abadb tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:51.402096 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-189c6924-ddad-4789-a760-889ab12464e4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:51.402449 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a838687e-763a-47b1-b264-9dce670abadb tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:51.404156 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a838687e-763a-47b1-b264-9dce670abadb tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:51.413783 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-189c6924-ddad-4789-a760-889ab12464e4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.263349 Oct 30 00:49:51.414897 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 134/271] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:51 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:51.420049 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e6b80d71-68f4-470c-9030-8c65dd392f48 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:51.421301 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-e6b80d71-68f4-470c-9030-8c65dd392f48 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:51.428772 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e6b80d71-68f4-470c-9030-8c65dd392f48 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:51.429417 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e6b80d71-68f4-470c-9030-8c65dd392f48 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:51.430013 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e6b80d71-68f4-470c-9030-8c65dd392f48 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:51.430712 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e6b80d71-68f4-470c-9030-8c65dd392f48 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:51.431156 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e6b80d71-68f4-470c-9030-8c65dd392f48 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:51.431705 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e6b80d71-68f4-470c-9030-8c65dd392f48 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:51.621682 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-a838687e-763a-47b1-b264-9dce670abadb tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:51.628796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-e6b80d71-68f4-470c-9030-8c65dd392f48 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:51.629601 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-a838687e-763a-47b1-b264-9dce670abadb tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.243011 Oct 30 00:49:51.630164 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 138/272] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:51 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:51.636862 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-e6b80d71-68f4-470c-9030-8c65dd392f48 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:51.638305 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-e6b80d71-68f4-470c-9030-8c65dd392f48 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:51.639914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e6b80d71-68f4-470c-9030-8c65dd392f48 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1407 microversion: 2.20 time: 0.223324 Oct 30 00:49:51.640653 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 135/273] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:51 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:49:52.394664 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c505b12f-27e5-4437-9fc1-4b26d8d9d2e1 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:52.395279 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c505b12f-27e5-4437-9fc1-4b26d8d9d2e1 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:52.401221 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c505b12f-27e5-4437-9fc1-4b26d8d9d2e1 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:52.401693 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c505b12f-27e5-4437-9fc1-4b26d8d9d2e1 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:52.402123 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c505b12f-27e5-4437-9fc1-4b26d8d9d2e1 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:52.402802 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c505b12f-27e5-4437-9fc1-4b26d8d9d2e1 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:52.403248 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c505b12f-27e5-4437-9fc1-4b26d8d9d2e1 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:52.403663 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c505b12f-27e5-4437-9fc1-4b26d8d9d2e1 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:52.438205 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-cd7a48fa-0e5e-4ec3-8ab1-c5a546938c1f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:52.438796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-cd7a48fa-0e5e-4ec3-8ab1-c5a546938c1f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:52.445350 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd7a48fa-0e5e-4ec3-8ab1-c5a546938c1f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:52.445824 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd7a48fa-0e5e-4ec3-8ab1-c5a546938c1f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:52.446250 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd7a48fa-0e5e-4ec3-8ab1-c5a546938c1f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:52.446927 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd7a48fa-0e5e-4ec3-8ab1-c5a546938c1f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:52.447368 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd7a48fa-0e5e-4ec3-8ab1-c5a546938c1f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:52.447782 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd7a48fa-0e5e-4ec3-8ab1-c5a546938c1f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:52.615166 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c505b12f-27e5-4437-9fc1-4b26d8d9d2e1 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:52.636406 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c505b12f-27e5-4437-9fc1-4b26d8d9d2e1 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.245434 Oct 30 00:49:52.637074 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 139/274] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:52 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:52.647734 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-cd7a48fa-0e5e-4ec3-8ab1-c5a546938c1f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:52.653376 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-8bb95677-2be7-4647-ba98-614ab2578cdd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:52.653974 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-8bb95677-2be7-4647-ba98-614ab2578cdd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:52.657358 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-cd7a48fa-0e5e-4ec3-8ab1-c5a546938c1f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.223555 Oct 30 00:49:52.658270 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 136/275] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:52 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:52.663116 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8bb95677-2be7-4647-ba98-614ab2578cdd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:52.663604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8bb95677-2be7-4647-ba98-614ab2578cdd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:52.664032 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8bb95677-2be7-4647-ba98-614ab2578cdd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:52.664850 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8bb95677-2be7-4647-ba98-614ab2578cdd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:52.665299 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8bb95677-2be7-4647-ba98-614ab2578cdd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:52.665748 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8bb95677-2be7-4647-ba98-614ab2578cdd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:52.676051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f672eafd-c1c6-4e44-8e1f-570f4efdf7fd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:52.676795 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f672eafd-c1c6-4e44-8e1f-570f4efdf7fd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:52.683398 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f672eafd-c1c6-4e44-8e1f-570f4efdf7fd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:52.683975 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f672eafd-c1c6-4e44-8e1f-570f4efdf7fd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:52.684505 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f672eafd-c1c6-4e44-8e1f-570f4efdf7fd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:52.685328 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f672eafd-c1c6-4e44-8e1f-570f4efdf7fd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:52.685904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f672eafd-c1c6-4e44-8e1f-570f4efdf7fd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:52.686515 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f672eafd-c1c6-4e44-8e1f-570f4efdf7fd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:52.876232 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-8bb95677-2be7-4647-ba98-614ab2578cdd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:52.878825 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f672eafd-c1c6-4e44-8e1f-570f4efdf7fd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:52.884567 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-8bb95677-2be7-4647-ba98-614ab2578cdd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.234888 Oct 30 00:49:52.885131 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 140/276] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:52 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:52.886858 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f672eafd-c1c6-4e44-8e1f-570f4efdf7fd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:52.888328 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f672eafd-c1c6-4e44-8e1f-570f4efdf7fd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:52.890600 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f672eafd-c1c6-4e44-8e1f-570f4efdf7fd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1599 microversion: 2.20 time: 0.229680 Oct 30 00:49:52.891405 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 137/277] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:49:52 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1599 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:49:52.915788 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-50d0b48a-03d5-4d25-bb4e-da3ecd366d20 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:52.916295 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-50d0b48a-03d5-4d25-bb4e-da3ecd366d20 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:52.922778 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50d0b48a-03d5-4d25-bb4e-da3ecd366d20 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:52.923242 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50d0b48a-03d5-4d25-bb4e-da3ecd366d20 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:52.923663 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50d0b48a-03d5-4d25-bb4e-da3ecd366d20 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:52.924369 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50d0b48a-03d5-4d25-bb4e-da3ecd366d20 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:52.924809 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50d0b48a-03d5-4d25-bb4e-da3ecd366d20 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:52.925221 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50d0b48a-03d5-4d25-bb4e-da3ecd366d20 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:53.037479 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-50d0b48a-03d5-4d25-bb4e-da3ecd366d20 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.125414 Oct 30 00:49:53.038064 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 141/278] 10.222.0.36 () {60 vars in 1316 bytes} [Sun Oct 30 00:49:52 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:49:53.661708 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f6c8ef04-a32e-4cda-ae26-a1dde909d6c9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:53.662248 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f6c8ef04-a32e-4cda-ae26-a1dde909d6c9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:53.668792 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6c8ef04-a32e-4cda-ae26-a1dde909d6c9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:53.669518 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6c8ef04-a32e-4cda-ae26-a1dde909d6c9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:53.669953 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6c8ef04-a32e-4cda-ae26-a1dde909d6c9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:53.670663 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6c8ef04-a32e-4cda-ae26-a1dde909d6c9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:53.671730 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6c8ef04-a32e-4cda-ae26-a1dde909d6c9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:53.672213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6c8ef04-a32e-4cda-ae26-a1dde909d6c9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:53.690312 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7e1a582e-a6d4-458d-9cda-1666b8b625b2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:53.690990 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-7e1a582e-a6d4-458d-9cda-1666b8b625b2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:53.698387 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7e1a582e-a6d4-458d-9cda-1666b8b625b2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:53.698882 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7e1a582e-a6d4-458d-9cda-1666b8b625b2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:53.699611 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7e1a582e-a6d4-458d-9cda-1666b8b625b2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:53.700429 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7e1a582e-a6d4-458d-9cda-1666b8b625b2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:53.701105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7e1a582e-a6d4-458d-9cda-1666b8b625b2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:53.701725 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7e1a582e-a6d4-458d-9cda-1666b8b625b2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:54.169421 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7e1a582e-a6d4-458d-9cda-1666b8b625b2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:54.177261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7e1a582e-a6d4-458d-9cda-1666b8b625b2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.497588 Oct 30 00:49:54.178015 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 142/279] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:53 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:54.180560 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f6c8ef04-a32e-4cda-ae26-a1dde909d6c9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:54.182534 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-25756000-54a4-4092-ad07-4eb3326ffe0a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:54.183138 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-25756000-54a4-4092-ad07-4eb3326ffe0a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:54.189799 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f6c8ef04-a32e-4cda-ae26-a1dde909d6c9 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.531399 Oct 30 00:49:54.190381 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 138/280] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:53 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:54.193827 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-25756000-54a4-4092-ad07-4eb3326ffe0a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:54.194315 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-25756000-54a4-4092-ad07-4eb3326ffe0a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:54.194778 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-25756000-54a4-4092-ad07-4eb3326ffe0a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:54.195474 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-25756000-54a4-4092-ad07-4eb3326ffe0a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:54.195924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-25756000-54a4-4092-ad07-4eb3326ffe0a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:54.196373 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-25756000-54a4-4092-ad07-4eb3326ffe0a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:54.401859 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-25756000-54a4-4092-ad07-4eb3326ffe0a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:54.410038 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-25756000-54a4-4092-ad07-4eb3326ffe0a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.231193 Oct 30 00:49:54.410590 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 143/281] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:54 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:54.648755 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-e61344e7-7341-42a9-9de4-c0db0c8193fe req-4d19a626-637b-4284-b521-8f6afcd05f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00747eb3-1c2b-40b2-8e0a-9c440529e833", "tag": "0b7471a7-8df2-4f56-8dad-8f89610685f3"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:49:54.659063 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-e61344e7-7341-42a9-9de4-c0db0c8193fe req-4d19a626-637b-4284-b521-8f6afcd05f8c service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:54.659620 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-e61344e7-7341-42a9-9de4-c0db0c8193fe req-4d19a626-637b-4284-b521-8f6afcd05f8c service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:54.660143 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-e61344e7-7341-42a9-9de4-c0db0c8193fe req-4d19a626-637b-4284-b521-8f6afcd05f8c service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:54.671848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-e61344e7-7341-42a9-9de4-c0db0c8193fe req-4d19a626-637b-4284-b521-8f6afcd05f8c service nova] Creating event network-changed:0b7471a7-8df2-4f56-8dad-8f89610685f3 for instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 on hv-cinder-86149 Oct 30 00:49:54.677318 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-e61344e7-7341-42a9-9de4-c0db0c8193fe req-4d19a626-637b-4284-b521-8f6afcd05f8c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032202 Oct 30 00:49:54.677995 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 139/282] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:49:55.202088 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-cc565513-aab8-4ce8-9d1c-1fbef24ef768 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:55.202967 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-cc565513-aab8-4ce8-9d1c-1fbef24ef768 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:55.209241 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cc565513-aab8-4ce8-9d1c-1fbef24ef768 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:55.209893 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cc565513-aab8-4ce8-9d1c-1fbef24ef768 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:55.210336 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cc565513-aab8-4ce8-9d1c-1fbef24ef768 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:55.211033 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cc565513-aab8-4ce8-9d1c-1fbef24ef768 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:55.211486 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cc565513-aab8-4ce8-9d1c-1fbef24ef768 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:55.212121 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cc565513-aab8-4ce8-9d1c-1fbef24ef768 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:55.213705 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-16aae7b5-efe0-4f51-b3cd-da99edf721ca tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:55.214407 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-16aae7b5-efe0-4f51-b3cd-da99edf721ca tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:55.220818 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-16aae7b5-efe0-4f51-b3cd-da99edf721ca tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:55.221297 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-16aae7b5-efe0-4f51-b3cd-da99edf721ca tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:55.221733 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-16aae7b5-efe0-4f51-b3cd-da99edf721ca tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:55.222428 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-16aae7b5-efe0-4f51-b3cd-da99edf721ca tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:55.222878 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-16aae7b5-efe0-4f51-b3cd-da99edf721ca tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:55.223299 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-16aae7b5-efe0-4f51-b3cd-da99edf721ca tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:55.376979 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-16aae7b5-efe0-4f51-b3cd-da99edf721ca tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:55.385125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-16aae7b5-efe0-4f51-b3cd-da99edf721ca tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.175938 Oct 30 00:49:55.385813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 140/283] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:55 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:55.445108 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-930775ac-1fa9-4751-942e-16faf3f9a159 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:55.450196 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-930775ac-1fa9-4751-942e-16faf3f9a159 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:55.469491 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-930775ac-1fa9-4751-942e-16faf3f9a159 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:55.472655 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-930775ac-1fa9-4751-942e-16faf3f9a159 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:55.475251 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-930775ac-1fa9-4751-942e-16faf3f9a159 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:55.478787 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-930775ac-1fa9-4751-942e-16faf3f9a159 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:55.479397 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-930775ac-1fa9-4751-942e-16faf3f9a159 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:55.481832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-930775ac-1fa9-4751-942e-16faf3f9a159 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:55.533029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-cc565513-aab8-4ce8-9d1c-1fbef24ef768 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:55.542090 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-cc565513-aab8-4ce8-9d1c-1fbef24ef768 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.343818 Oct 30 00:49:55.552500 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 144/284] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:55 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:55.699669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-930775ac-1fa9-4751-942e-16faf3f9a159 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:55.720395 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-930775ac-1fa9-4751-942e-16faf3f9a159 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.290184 Oct 30 00:49:55.721675 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 141/285] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:55 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:56.000074 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-2367cefd-161c-4e77-9d87-f4e6e5de733f req-dcfe10fd-4e3d-4c41-aa0d-dbc7a25c844f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4250f845-2f85-48d9-bf11-5b7093520b26", "name": "network-vif-plugged", "status": "completed", "tag": "bc753166-f353-4e52-8984-d2a862e879f6"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:49:56.024027 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-2367cefd-161c-4e77-9d87-f4e6e5de733f req-dcfe10fd-4e3d-4c41-aa0d-dbc7a25c844f service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:56.024852 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-2367cefd-161c-4e77-9d87-f4e6e5de733f req-dcfe10fd-4e3d-4c41-aa0d-dbc7a25c844f service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:56.025604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-2367cefd-161c-4e77-9d87-f4e6e5de733f req-dcfe10fd-4e3d-4c41-aa0d-dbc7a25c844f service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:56.057623 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-2367cefd-161c-4e77-9d87-f4e6e5de733f req-dcfe10fd-4e3d-4c41-aa0d-dbc7a25c844f service nova] Creating event network-vif-plugged:bc753166-f353-4e52-8984-d2a862e879f6 for instance 4250f845-2f85-48d9-bf11-5b7093520b26 on hv-cinder-86149 Oct 30 00:49:56.065147 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-2367cefd-161c-4e77-9d87-f4e6e5de733f req-dcfe10fd-4e3d-4c41-aa0d-dbc7a25c844f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068629 Oct 30 00:49:56.066394 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 145/286] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:49:56.407494 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-eb07ad2f-4400-4689-8d7e-e6f854ffb0c5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:56.408139 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-eb07ad2f-4400-4689-8d7e-e6f854ffb0c5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:56.414777 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-eb07ad2f-4400-4689-8d7e-e6f854ffb0c5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:56.415405 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-eb07ad2f-4400-4689-8d7e-e6f854ffb0c5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:56.415943 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-eb07ad2f-4400-4689-8d7e-e6f854ffb0c5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:56.416675 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-eb07ad2f-4400-4689-8d7e-e6f854ffb0c5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:56.417122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-eb07ad2f-4400-4689-8d7e-e6f854ffb0c5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:56.417537 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-eb07ad2f-4400-4689-8d7e-e6f854ffb0c5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:56.568858 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2924da0f-560d-431b-8366-935a3440e4c6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:56.570135 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2924da0f-560d-431b-8366-935a3440e4c6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:56.574296 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-eb07ad2f-4400-4689-8d7e-e6f854ffb0c5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:56.581922 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2924da0f-560d-431b-8366-935a3440e4c6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:56.583625 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2924da0f-560d-431b-8366-935a3440e4c6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:56.584058 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2924da0f-560d-431b-8366-935a3440e4c6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:56.584783 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2924da0f-560d-431b-8366-935a3440e4c6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:56.585252 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2924da0f-560d-431b-8366-935a3440e4c6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:56.590119 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-eb07ad2f-4400-4689-8d7e-e6f854ffb0c5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1315 microversion: 2.1 time: 0.186653 Oct 30 00:49:56.590676 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 142/287] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:56 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:56.607385 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2924da0f-560d-431b-8366-935a3440e4c6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:56.743804 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2924da0f-560d-431b-8366-935a3440e4c6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:56.746837 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1343c749-d1dd-4416-a9cd-3f8984e9eb8c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:56.752051 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2924da0f-560d-431b-8366-935a3440e4c6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.188186 Oct 30 00:49:56.752939 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1343c749-d1dd-4416-a9cd-3f8984e9eb8c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:56.760029 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1343c749-d1dd-4416-a9cd-3f8984e9eb8c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:56.760621 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1343c749-d1dd-4416-a9cd-3f8984e9eb8c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:56.761181 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1343c749-d1dd-4416-a9cd-3f8984e9eb8c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:56.761937 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1343c749-d1dd-4416-a9cd-3f8984e9eb8c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:56.762617 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1343c749-d1dd-4416-a9cd-3f8984e9eb8c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:56.763038 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1343c749-d1dd-4416-a9cd-3f8984e9eb8c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:56.765971 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 146/288] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:56 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:56.935537 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1343c749-d1dd-4416-a9cd-3f8984e9eb8c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:56.944623 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1343c749-d1dd-4416-a9cd-3f8984e9eb8c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.201571 Oct 30 00:49:56.945166 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 143/289] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:56 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:57.622212 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-8cd97791-b4d1-40f4-b967-dc60308ac8fc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:57.622920 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-8cd97791-b4d1-40f4-b967-dc60308ac8fc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:57.636563 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8cd97791-b4d1-40f4-b967-dc60308ac8fc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:57.637439 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8cd97791-b4d1-40f4-b967-dc60308ac8fc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:57.638327 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8cd97791-b4d1-40f4-b967-dc60308ac8fc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:57.639271 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8cd97791-b4d1-40f4-b967-dc60308ac8fc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:57.641198 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8cd97791-b4d1-40f4-b967-dc60308ac8fc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:57.641840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8cd97791-b4d1-40f4-b967-dc60308ac8fc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:57.789885 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-7989c689-47b8-457f-966b-660006a479c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:57.790462 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-7989c689-47b8-457f-966b-660006a479c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:57.806777 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7989c689-47b8-457f-966b-660006a479c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:57.809320 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7989c689-47b8-457f-966b-660006a479c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:57.811300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7989c689-47b8-457f-966b-660006a479c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:57.812783 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7989c689-47b8-457f-966b-660006a479c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:57.815083 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7989c689-47b8-457f-966b-660006a479c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:57.816421 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7989c689-47b8-457f-966b-660006a479c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:58.064857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-8cd97791-b4d1-40f4-b967-dc60308ac8fc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:58.077679 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-8cd97791-b4d1-40f4-b967-dc60308ac8fc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1503 microversion: 2.1 time: 0.466144 Oct 30 00:49:58.078682 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 147/290] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:57 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1503 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:58.088409 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-54f3f93d-bd95-4a0b-9eff-5850645ab394 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:58.089015 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-54f3f93d-bd95-4a0b-9eff-5850645ab394 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:58.106895 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-54f3f93d-bd95-4a0b-9eff-5850645ab394 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:58.107707 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-54f3f93d-bd95-4a0b-9eff-5850645ab394 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:58.110148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-54f3f93d-bd95-4a0b-9eff-5850645ab394 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:58.111420 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-54f3f93d-bd95-4a0b-9eff-5850645ab394 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:58.112238 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-54f3f93d-bd95-4a0b-9eff-5850645ab394 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:58.113246 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-54f3f93d-bd95-4a0b-9eff-5850645ab394 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:58.263135 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-7989c689-47b8-457f-966b-660006a479c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:58.279724 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-7989c689-47b8-457f-966b-660006a479c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.506200 Oct 30 00:49:58.280508 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 144/291] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:57 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:49:58.402767 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-54f3f93d-bd95-4a0b-9eff-5850645ab394 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:58.413591 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-54f3f93d-bd95-4a0b-9eff-5850645ab394 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.329895 Oct 30 00:49:58.414165 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 148/292] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:58 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:59.306005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a9292a34-fa67-44aa-aa1d-a45cb4749f57 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:59.306615 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a9292a34-fa67-44aa-aa1d-a45cb4749f57 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:59.318143 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9292a34-fa67-44aa-aa1d-a45cb4749f57 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:59.318930 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9292a34-fa67-44aa-aa1d-a45cb4749f57 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:59.319358 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9292a34-fa67-44aa-aa1d-a45cb4749f57 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:59.320259 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9292a34-fa67-44aa-aa1d-a45cb4749f57 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:59.320980 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9292a34-fa67-44aa-aa1d-a45cb4749f57 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:59.321476 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9292a34-fa67-44aa-aa1d-a45cb4749f57 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:59.438900 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-82a19631-1cf2-481b-aaf8-6d7ccedd7351 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:49:59.439754 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-82a19631-1cf2-481b-aaf8-6d7ccedd7351 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:49:59.451662 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-82a19631-1cf2-481b-aaf8-6d7ccedd7351 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:59.452207 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-82a19631-1cf2-481b-aaf8-6d7ccedd7351 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:59.452801 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-82a19631-1cf2-481b-aaf8-6d7ccedd7351 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:59.453808 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-82a19631-1cf2-481b-aaf8-6d7ccedd7351 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:49:59.454417 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-82a19631-1cf2-481b-aaf8-6d7ccedd7351 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:49:59.455317 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-82a19631-1cf2-481b-aaf8-6d7ccedd7351 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:49:59.515795 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a9292a34-fa67-44aa-aa1d-a45cb4749f57 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:59.525135 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a9292a34-fa67-44aa-aa1d-a45cb4749f57 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.222834 Oct 30 00:49:59.526741 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 145/293] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:59 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:49:59.621048 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-82a19631-1cf2-481b-aaf8-6d7ccedd7351 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:49:59.629369 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-82a19631-1cf2-481b-aaf8-6d7ccedd7351 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.194497 Oct 30 00:49:59.629988 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 149/294] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:49:59 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:50:00.551300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-6f1647b4-0d59-45ef-9703-65e813bcfc0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:00.552781 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-6f1647b4-0d59-45ef-9703-65e813bcfc0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:00.559481 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6f1647b4-0d59-45ef-9703-65e813bcfc0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:00.560142 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6f1647b4-0d59-45ef-9703-65e813bcfc0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:00.560580 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6f1647b4-0d59-45ef-9703-65e813bcfc0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:00.561996 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6f1647b4-0d59-45ef-9703-65e813bcfc0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:00.562658 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6f1647b4-0d59-45ef-9703-65e813bcfc0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:00.563351 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6f1647b4-0d59-45ef-9703-65e813bcfc0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:00.656143 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-0899528d-4011-4f51-8881-dddb61f2e7bd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:00.657237 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-0899528d-4011-4f51-8881-dddb61f2e7bd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:00.665406 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0899528d-4011-4f51-8881-dddb61f2e7bd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:00.666141 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0899528d-4011-4f51-8881-dddb61f2e7bd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:00.666988 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0899528d-4011-4f51-8881-dddb61f2e7bd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:00.667812 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0899528d-4011-4f51-8881-dddb61f2e7bd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:00.668409 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0899528d-4011-4f51-8881-dddb61f2e7bd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:00.669271 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0899528d-4011-4f51-8881-dddb61f2e7bd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:00.706350 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-6f1647b4-0d59-45ef-9703-65e813bcfc0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:00.713953 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-6f1647b4-0d59-45ef-9703-65e813bcfc0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.168251 Oct 30 00:50:00.714522 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 146/295] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:00 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:00.881928 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-0899528d-4011-4f51-8881-dddb61f2e7bd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:00.889814 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-0899528d-4011-4f51-8881-dddb61f2e7bd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.241260 Oct 30 00:50:00.890726 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 150/296] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:00 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:50:01.737636 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-02a0ef36-70b3-4cf7-a9a7-fb98ddb5aadb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:01.738452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-02a0ef36-70b3-4cf7-a9a7-fb98ddb5aadb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:01.744466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-02a0ef36-70b3-4cf7-a9a7-fb98ddb5aadb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:01.744944 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-02a0ef36-70b3-4cf7-a9a7-fb98ddb5aadb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:01.745407 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-02a0ef36-70b3-4cf7-a9a7-fb98ddb5aadb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:01.746090 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-02a0ef36-70b3-4cf7-a9a7-fb98ddb5aadb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:01.746533 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-02a0ef36-70b3-4cf7-a9a7-fb98ddb5aadb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:01.746950 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-02a0ef36-70b3-4cf7-a9a7-fb98ddb5aadb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:01.762852 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=100 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:01.886830 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-02a0ef36-70b3-4cf7-a9a7-fb98ddb5aadb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:01.902803 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-02a0ef36-70b3-4cf7-a9a7-fb98ddb5aadb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.169251 Oct 30 00:50:01.903440 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 147/297] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:01 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:01.917561 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-3872823d-7bd4-458e-a6fc-8e68bf8d6cc4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:01.918294 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-3872823d-7bd4-458e-a6fc-8e68bf8d6cc4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:01.927722 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3872823d-7bd4-458e-a6fc-8e68bf8d6cc4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:01.928236 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3872823d-7bd4-458e-a6fc-8e68bf8d6cc4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:01.928673 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3872823d-7bd4-458e-a6fc-8e68bf8d6cc4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:01.929362 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3872823d-7bd4-458e-a6fc-8e68bf8d6cc4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:01.929806 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3872823d-7bd4-458e-a6fc-8e68bf8d6cc4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:01.930224 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3872823d-7bd4-458e-a6fc-8e68bf8d6cc4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:01.949647 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=100 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:02.067717 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-3872823d-7bd4-458e-a6fc-8e68bf8d6cc4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:02.075336 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-3872823d-7bd4-458e-a6fc-8e68bf8d6cc4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.161969 Oct 30 00:50:02.075890 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 151/298] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:01 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:50:02.924997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3b6972ff-a5e8-4f14-89bc-5231e7363cc8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:02.926283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-3b6972ff-a5e8-4f14-89bc-5231e7363cc8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:02.932970 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3b6972ff-a5e8-4f14-89bc-5231e7363cc8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:02.933517 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3b6972ff-a5e8-4f14-89bc-5231e7363cc8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:02.934012 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3b6972ff-a5e8-4f14-89bc-5231e7363cc8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:02.934762 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3b6972ff-a5e8-4f14-89bc-5231e7363cc8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:02.935307 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3b6972ff-a5e8-4f14-89bc-5231e7363cc8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:02.935805 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3b6972ff-a5e8-4f14-89bc-5231e7363cc8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:03.070538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3b6972ff-a5e8-4f14-89bc-5231e7363cc8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:03.078841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-3b6972ff-a5e8-4f14-89bc-5231e7363cc8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.158233 Oct 30 00:50:03.079383 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 148/299] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:02 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:03.098985 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-6f3d1329-967d-442a-aaa1-45d35b425bb1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:03.099583 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-6f3d1329-967d-442a-aaa1-45d35b425bb1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:03.105580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6f3d1329-967d-442a-aaa1-45d35b425bb1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:03.106050 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6f3d1329-967d-442a-aaa1-45d35b425bb1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:03.106502 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6f3d1329-967d-442a-aaa1-45d35b425bb1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:03.107173 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6f3d1329-967d-442a-aaa1-45d35b425bb1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:03.107614 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6f3d1329-967d-442a-aaa1-45d35b425bb1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:03.108610 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6f3d1329-967d-442a-aaa1-45d35b425bb1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:03.242990 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6f3d1329-967d-442a-aaa1-45d35b425bb1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:03.251104 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-6f3d1329-967d-442a-aaa1-45d35b425bb1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1321 microversion: 2.1 time: 0.156005 Oct 30 00:50:03.251648 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 152/300] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:03 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:04.103251 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5b3f6bfa-8d3e-4c8f-850d-1ab465e00d44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:04.103843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5b3f6bfa-8d3e-4c8f-850d-1ab465e00d44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:04.110417 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5b3f6bfa-8d3e-4c8f-850d-1ab465e00d44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:04.110885 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5b3f6bfa-8d3e-4c8f-850d-1ab465e00d44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:04.111310 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5b3f6bfa-8d3e-4c8f-850d-1ab465e00d44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:04.111985 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5b3f6bfa-8d3e-4c8f-850d-1ab465e00d44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:04.112466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5b3f6bfa-8d3e-4c8f-850d-1ab465e00d44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:04.112892 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5b3f6bfa-8d3e-4c8f-850d-1ab465e00d44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:04.245273 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5b3f6bfa-8d3e-4c8f-850d-1ab465e00d44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:04.254239 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5b3f6bfa-8d3e-4c8f-850d-1ab465e00d44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1363 microversion: 2.1 time: 0.155776 Oct 30 00:50:04.254786 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 149/301] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:04 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:04.274315 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f7c31369-b1d7-430a-9bb4-92429fb18d65 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:04.274914 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-f7c31369-b1d7-430a-9bb4-92429fb18d65 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:04.281037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f7c31369-b1d7-430a-9bb4-92429fb18d65 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:04.281516 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f7c31369-b1d7-430a-9bb4-92429fb18d65 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:04.281945 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f7c31369-b1d7-430a-9bb4-92429fb18d65 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:04.282625 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f7c31369-b1d7-430a-9bb4-92429fb18d65 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:04.283072 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f7c31369-b1d7-430a-9bb4-92429fb18d65 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:04.283490 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f7c31369-b1d7-430a-9bb4-92429fb18d65 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:04.424289 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-f7c31369-b1d7-430a-9bb4-92429fb18d65 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:04.431903 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-f7c31369-b1d7-430a-9bb4-92429fb18d65 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1515 microversion: 2.1 time: 0.161559 Oct 30 00:50:04.432575 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 153/302] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:04 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:04.457458 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-13bb7d66-f2f5-4658-bbc5-0e98eae16bfb tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:50:04.459673 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-13bb7d66-f2f5-4658-bbc5-0e98eae16bfb tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:04.466125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-13bb7d66-f2f5-4658-bbc5-0e98eae16bfb tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:04.466599 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-13bb7d66-f2f5-4658-bbc5-0e98eae16bfb tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:04.467027 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-13bb7d66-f2f5-4658-bbc5-0e98eae16bfb tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:04.467966 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-13bb7d66-f2f5-4658-bbc5-0e98eae16bfb tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:04.468455 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-13bb7d66-f2f5-4658-bbc5-0e98eae16bfb tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:04.468865 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-13bb7d66-f2f5-4658-bbc5-0e98eae16bfb tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:04.531291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.objects.instance [None req-13bb7d66-f2f5-4658-bbc5-0e98eae16bfb tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lazy-loading 'flavor' on Instance uuid fc267534-c882-4793-a8f9-17df60c7fa64 {{(pid=125553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:50:04.655058 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-13bb7d66-f2f5-4658-bbc5-0e98eae16bfb tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "POST /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64/action" status: 200 len: 32 microversion: 2.1 time: 0.201545 Oct 30 00:50:04.655802 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 150/303] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Oct 30 00:50:04 2022] POST /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64/action => generated 32 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 00:50:04.665224 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-043e01a0-137e-4ef0-863b-421d968972f5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:04.666154 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-043e01a0-137e-4ef0-863b-421d968972f5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:04.672752 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-043e01a0-137e-4ef0-863b-421d968972f5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:04.673228 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-043e01a0-137e-4ef0-863b-421d968972f5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:04.673658 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-043e01a0-137e-4ef0-863b-421d968972f5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:04.674337 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-043e01a0-137e-4ef0-863b-421d968972f5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:04.674785 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-043e01a0-137e-4ef0-863b-421d968972f5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:04.675201 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-043e01a0-137e-4ef0-863b-421d968972f5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:04.823148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-043e01a0-137e-4ef0-863b-421d968972f5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:04.831995 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-043e01a0-137e-4ef0-863b-421d968972f5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.170332 Oct 30 00:50:04.832506 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 154/304] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:04 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:05.183379 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a201d639-f45b-467d-8f2b-f7b805a4e812 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52f88fb2-d0f3-4e81-8334-8ce44a825ea7"}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:50:05.186819 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a201d639-f45b-467d-8f2b-f7b805a4e812 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:05.195230 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a201d639-f45b-467d-8f2b-f7b805a4e812 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:05.196010 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a201d639-f45b-467d-8f2b-f7b805a4e812 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:05.196678 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a201d639-f45b-467d-8f2b-f7b805a4e812 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:05.197573 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a201d639-f45b-467d-8f2b-f7b805a4e812 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:05.198281 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a201d639-f45b-467d-8f2b-f7b805a4e812 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:05.198919 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a201d639-f45b-467d-8f2b-f7b805a4e812 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:05.280281 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-0fc34549-ad6b-4845-a7dd-5cc7ec55e46f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:05.281439 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-0fc34549-ad6b-4845-a7dd-5cc7ec55e46f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:05.295272 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0fc34549-ad6b-4845-a7dd-5cc7ec55e46f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:05.299152 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0fc34549-ad6b-4845-a7dd-5cc7ec55e46f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:05.300691 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0fc34549-ad6b-4845-a7dd-5cc7ec55e46f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:05.301657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0fc34549-ad6b-4845-a7dd-5cc7ec55e46f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:05.302292 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0fc34549-ad6b-4845-a7dd-5cc7ec55e46f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:05.302968 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0fc34549-ad6b-4845-a7dd-5cc7ec55e46f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:05.483413 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-0fc34549-ad6b-4845-a7dd-5cc7ec55e46f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:05.492428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-0fc34549-ad6b-4845-a7dd-5cc7ec55e46f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1548 microversion: 2.1 time: 0.218907 Oct 30 00:50:05.493183 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 155/305] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:05 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1548 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:50:05.520242 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-793c80c0-4cce-4c85-ace9-78a2f689bf51 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:05.520730 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-793c80c0-4cce-4c85-ace9-78a2f689bf51 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:05.526667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-793c80c0-4cce-4c85-ace9-78a2f689bf51 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:05.527148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-793c80c0-4cce-4c85-ace9-78a2f689bf51 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:05.527573 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-793c80c0-4cce-4c85-ace9-78a2f689bf51 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:05.528282 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-793c80c0-4cce-4c85-ace9-78a2f689bf51 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:05.528731 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-793c80c0-4cce-4c85-ace9-78a2f689bf51 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:05.529146 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-793c80c0-4cce-4c85-ace9-78a2f689bf51 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:05.605317 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-793c80c0-4cce-4c85-ace9-78a2f689bf51 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088896 Oct 30 00:50:05.605899 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 156/306] 10.222.0.36 () {58 vars in 1275 bytes} [Sun Oct 30 00:50:05 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 00:50:05.855730 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4619af40-178a-4df0-9f40-4da221d7b4e5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:05.856627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-4619af40-178a-4df0-9f40-4da221d7b4e5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:05.863913 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4619af40-178a-4df0-9f40-4da221d7b4e5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:05.864436 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4619af40-178a-4df0-9f40-4da221d7b4e5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:05.864861 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4619af40-178a-4df0-9f40-4da221d7b4e5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:05.865548 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4619af40-178a-4df0-9f40-4da221d7b4e5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:05.865991 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4619af40-178a-4df0-9f40-4da221d7b4e5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:05.866403 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4619af40-178a-4df0-9f40-4da221d7b4e5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:06.308307 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4619af40-178a-4df0-9f40-4da221d7b4e5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:06.316916 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-4619af40-178a-4df0-9f40-4da221d7b4e5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.465904 Oct 30 00:50:06.317726 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 157/307] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:05 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:06.827874 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-0992c160-3bc2-4dee-ac7f-e3d97937094c req-c5e6ff7f-dd79-4556-b3ca-660a1e6636a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4250f845-2f85-48d9-bf11-5b7093520b26", "tag": "bc753166-f353-4e52-8984-d2a862e879f6"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:50:06.832719 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=90 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:06.838617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-0992c160-3bc2-4dee-ac7f-e3d97937094c req-c5e6ff7f-dd79-4556-b3ca-660a1e6636a5 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:06.839085 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-0992c160-3bc2-4dee-ac7f-e3d97937094c req-c5e6ff7f-dd79-4556-b3ca-660a1e6636a5 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:06.839509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-0992c160-3bc2-4dee-ac7f-e3d97937094c req-c5e6ff7f-dd79-4556-b3ca-660a1e6636a5 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:06.851090 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-0992c160-3bc2-4dee-ac7f-e3d97937094c req-c5e6ff7f-dd79-4556-b3ca-660a1e6636a5 service nova] Creating event network-changed:bc753166-f353-4e52-8984-d2a862e879f6 for instance 4250f845-2f85-48d9-bf11-5b7093520b26 on hv-cinder-86149 Oct 30 00:50:06.855917 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-0992c160-3bc2-4dee-ac7f-e3d97937094c req-c5e6ff7f-dd79-4556-b3ca-660a1e6636a5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032478 Oct 30 00:50:06.856531 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 158/308] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 00:50:07.340681 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-e271c6f7-6cf6-4a39-a042-3b999ea29db0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:07.341367 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-e271c6f7-6cf6-4a39-a042-3b999ea29db0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:07.347798 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e271c6f7-6cf6-4a39-a042-3b999ea29db0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:07.348315 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e271c6f7-6cf6-4a39-a042-3b999ea29db0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:07.348748 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e271c6f7-6cf6-4a39-a042-3b999ea29db0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:07.349435 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e271c6f7-6cf6-4a39-a042-3b999ea29db0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:07.349882 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e271c6f7-6cf6-4a39-a042-3b999ea29db0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:07.350300 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e271c6f7-6cf6-4a39-a042-3b999ea29db0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:07.496391 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e271c6f7-6cf6-4a39-a042-3b999ea29db0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:07.505219 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-e271c6f7-6cf6-4a39-a042-3b999ea29db0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.168723 Oct 30 00:50:07.505775 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 159/309] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:07 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:50:08.528239 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b4c020db-be39-4905-b3e9-e5b4ea480de9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:08.528850 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-b4c020db-be39-4905-b3e9-e5b4ea480de9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:08.534958 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b4c020db-be39-4905-b3e9-e5b4ea480de9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:08.535435 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b4c020db-be39-4905-b3e9-e5b4ea480de9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:08.535859 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b4c020db-be39-4905-b3e9-e5b4ea480de9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:08.536562 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b4c020db-be39-4905-b3e9-e5b4ea480de9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:08.537002 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b4c020db-be39-4905-b3e9-e5b4ea480de9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:08.537415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b4c020db-be39-4905-b3e9-e5b4ea480de9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:08.666483 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b4c020db-be39-4905-b3e9-e5b4ea480de9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:08.675007 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b4c020db-be39-4905-b3e9-e5b4ea480de9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.150507 Oct 30 00:50:08.675561 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 160/310] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:08 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:50:09.699348 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-30cd9e8b-144f-4de0-a2ea-92738b97fdce tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:09.699991 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-30cd9e8b-144f-4de0-a2ea-92738b97fdce tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:09.707438 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30cd9e8b-144f-4de0-a2ea-92738b97fdce tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:09.707915 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30cd9e8b-144f-4de0-a2ea-92738b97fdce tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:09.708365 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30cd9e8b-144f-4de0-a2ea-92738b97fdce tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:09.709053 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30cd9e8b-144f-4de0-a2ea-92738b97fdce tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:09.709495 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30cd9e8b-144f-4de0-a2ea-92738b97fdce tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:09.709908 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30cd9e8b-144f-4de0-a2ea-92738b97fdce tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:09.840286 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-30cd9e8b-144f-4de0-a2ea-92738b97fdce tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:09.848139 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-30cd9e8b-144f-4de0-a2ea-92738b97fdce tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.153301 Oct 30 00:50:09.848695 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 161/311] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:09 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:50:10.870915 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-12154e19-739e-4d59-983f-e26eff97d241 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:10.871521 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-12154e19-739e-4d59-983f-e26eff97d241 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:10.878058 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-12154e19-739e-4d59-983f-e26eff97d241 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:10.878532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-12154e19-739e-4d59-983f-e26eff97d241 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:10.878953 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-12154e19-739e-4d59-983f-e26eff97d241 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:10.879627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-12154e19-739e-4d59-983f-e26eff97d241 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:10.880068 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-12154e19-739e-4d59-983f-e26eff97d241 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:10.880507 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-12154e19-739e-4d59-983f-e26eff97d241 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:11.081879 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-12154e19-739e-4d59-983f-e26eff97d241 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:11.093324 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-12154e19-739e-4d59-983f-e26eff97d241 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.225361 Oct 30 00:50:11.093949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 162/312] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:10 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:50:11.146684 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a201d639-f45b-467d-8f2b-f7b805a4e812 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "POST /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.969141 Oct 30 00:50:11.151513 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 151/313] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Oct 30 00:50:05 2022] POST /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85/os-volume_attachments => generated 194 bytes in 5972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:50:12.116738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ec9afc4a-104b-4be5-84a6-3f573400957a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:12.117347 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ec9afc4a-104b-4be5-84a6-3f573400957a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:12.123207 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ec9afc4a-104b-4be5-84a6-3f573400957a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:12.124239 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ec9afc4a-104b-4be5-84a6-3f573400957a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:12.124809 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ec9afc4a-104b-4be5-84a6-3f573400957a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:12.125648 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ec9afc4a-104b-4be5-84a6-3f573400957a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:12.126153 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ec9afc4a-104b-4be5-84a6-3f573400957a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:12.126577 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ec9afc4a-104b-4be5-84a6-3f573400957a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:12.255837 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ec9afc4a-104b-4be5-84a6-3f573400957a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:12.264992 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ec9afc4a-104b-4be5-84a6-3f573400957a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.151628 Oct 30 00:50:12.265563 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 163/314] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:12 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:13.287911 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-cf3498ec-dcd2-40ec-ae99-481b278b6315 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:13.288724 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-cf3498ec-dcd2-40ec-ae99-481b278b6315 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:13.296733 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cf3498ec-dcd2-40ec-ae99-481b278b6315 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:13.297241 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cf3498ec-dcd2-40ec-ae99-481b278b6315 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:13.297677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cf3498ec-dcd2-40ec-ae99-481b278b6315 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:13.298520 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cf3498ec-dcd2-40ec-ae99-481b278b6315 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:13.298974 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cf3498ec-dcd2-40ec-ae99-481b278b6315 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:13.299526 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cf3498ec-dcd2-40ec-ae99-481b278b6315 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:13.456005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-cf3498ec-dcd2-40ec-ae99-481b278b6315 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:13.464211 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-cf3498ec-dcd2-40ec-ae99-481b278b6315 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.180890 Oct 30 00:50:13.464995 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 152/315] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:13 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:14.488587 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-087b8278-9992-48b1-9a14-a8d76f6275b9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:14.489195 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-087b8278-9992-48b1-9a14-a8d76f6275b9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:14.495580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-087b8278-9992-48b1-9a14-a8d76f6275b9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:14.496065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-087b8278-9992-48b1-9a14-a8d76f6275b9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:14.496546 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-087b8278-9992-48b1-9a14-a8d76f6275b9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:14.497289 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-087b8278-9992-48b1-9a14-a8d76f6275b9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:14.497749 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-087b8278-9992-48b1-9a14-a8d76f6275b9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:14.498244 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-087b8278-9992-48b1-9a14-a8d76f6275b9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:14.634580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-087b8278-9992-48b1-9a14-a8d76f6275b9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:14.643025 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-087b8278-9992-48b1-9a14-a8d76f6275b9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.158358 Oct 30 00:50:14.643581 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 164/316] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:14 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:15.667013 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c605f97d-c91a-4d78-9404-fe92757d7300 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:15.667705 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-c605f97d-c91a-4d78-9404-fe92757d7300 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:15.677278 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c605f97d-c91a-4d78-9404-fe92757d7300 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:15.677764 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c605f97d-c91a-4d78-9404-fe92757d7300 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:15.678227 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c605f97d-c91a-4d78-9404-fe92757d7300 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:15.678932 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c605f97d-c91a-4d78-9404-fe92757d7300 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:15.679381 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c605f97d-c91a-4d78-9404-fe92757d7300 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:15.679801 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c605f97d-c91a-4d78-9404-fe92757d7300 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:15.822336 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c605f97d-c91a-4d78-9404-fe92757d7300 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:15.831632 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c605f97d-c91a-4d78-9404-fe92757d7300 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.168262 Oct 30 00:50:15.832226 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 153/317] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:15 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:16.854636 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-0690ec9c-89dc-4ab5-bd8b-54b9ff553198 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:16.855255 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-0690ec9c-89dc-4ab5-bd8b-54b9ff553198 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:16.862097 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0690ec9c-89dc-4ab5-bd8b-54b9ff553198 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:16.862575 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0690ec9c-89dc-4ab5-bd8b-54b9ff553198 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:16.863003 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0690ec9c-89dc-4ab5-bd8b-54b9ff553198 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:16.863683 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0690ec9c-89dc-4ab5-bd8b-54b9ff553198 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:16.864159 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0690ec9c-89dc-4ab5-bd8b-54b9ff553198 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:16.864577 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0690ec9c-89dc-4ab5-bd8b-54b9ff553198 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:17.003537 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-0690ec9c-89dc-4ab5-bd8b-54b9ff553198 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:17.011438 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-0690ec9c-89dc-4ab5-bd8b-54b9ff553198 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.160586 Oct 30 00:50:17.011996 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 165/318] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:16 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:18.035766 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-0b33ab24-d11c-4915-a002-bed1d1acb7cd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:18.036558 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-0b33ab24-d11c-4915-a002-bed1d1acb7cd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:18.039951 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=56 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:18.043455 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0b33ab24-d11c-4915-a002-bed1d1acb7cd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:18.044167 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0b33ab24-d11c-4915-a002-bed1d1acb7cd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:18.044598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0b33ab24-d11c-4915-a002-bed1d1acb7cd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:18.045407 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0b33ab24-d11c-4915-a002-bed1d1acb7cd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:18.046470 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0b33ab24-d11c-4915-a002-bed1d1acb7cd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:18.046890 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0b33ab24-d11c-4915-a002-bed1d1acb7cd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:18.183754 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-0b33ab24-d11c-4915-a002-bed1d1acb7cd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:18.193493 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-0b33ab24-d11c-4915-a002-bed1d1acb7cd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.161752 Oct 30 00:50:18.212712 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 154/319] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:18 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:19.218692 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-78b35153-78af-4e35-b9aa-75713942d90c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:19.219302 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-78b35153-78af-4e35-b9aa-75713942d90c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:19.225255 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78b35153-78af-4e35-b9aa-75713942d90c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:19.225734 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78b35153-78af-4e35-b9aa-75713942d90c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:19.226171 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78b35153-78af-4e35-b9aa-75713942d90c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:19.226861 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78b35153-78af-4e35-b9aa-75713942d90c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:19.227313 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78b35153-78af-4e35-b9aa-75713942d90c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:19.227738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78b35153-78af-4e35-b9aa-75713942d90c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:19.383560 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-78b35153-78af-4e35-b9aa-75713942d90c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:19.392727 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-78b35153-78af-4e35-b9aa-75713942d90c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.178515 Oct 30 00:50:19.393332 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 166/320] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:19 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:20.416994 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1efc8b09-cdac-412b-b1d7-399b90e8dabf tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:20.417887 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1efc8b09-cdac-412b-b1d7-399b90e8dabf tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:20.425785 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1efc8b09-cdac-412b-b1d7-399b90e8dabf tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:20.426698 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1efc8b09-cdac-412b-b1d7-399b90e8dabf tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:20.427234 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1efc8b09-cdac-412b-b1d7-399b90e8dabf tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:20.428058 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1efc8b09-cdac-412b-b1d7-399b90e8dabf tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:20.428610 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1efc8b09-cdac-412b-b1d7-399b90e8dabf tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:20.429036 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1efc8b09-cdac-412b-b1d7-399b90e8dabf tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:20.575014 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1efc8b09-cdac-412b-b1d7-399b90e8dabf tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:20.583661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1efc8b09-cdac-412b-b1d7-399b90e8dabf tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.170668 Oct 30 00:50:20.584263 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 155/321] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:20 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:21.609412 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4446765c-24ff-4bc6-aa9c-36cf74228f69 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:21.610003 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-4446765c-24ff-4bc6-aa9c-36cf74228f69 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:21.617510 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4446765c-24ff-4bc6-aa9c-36cf74228f69 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:21.618010 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4446765c-24ff-4bc6-aa9c-36cf74228f69 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:21.618437 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4446765c-24ff-4bc6-aa9c-36cf74228f69 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:21.619239 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4446765c-24ff-4bc6-aa9c-36cf74228f69 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:21.619772 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4446765c-24ff-4bc6-aa9c-36cf74228f69 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:21.620226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4446765c-24ff-4bc6-aa9c-36cf74228f69 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:21.751439 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4446765c-24ff-4bc6-aa9c-36cf74228f69 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:21.759065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-4446765c-24ff-4bc6-aa9c-36cf74228f69 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.155044 Oct 30 00:50:21.759622 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 167/322] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:21 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:21.926684 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f0b58062-476a-4b09-8b14-00f0c9ac7921 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:21.927223 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f0b58062-476a-4b09-8b14-00f0c9ac7921 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:21.934073 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f0b58062-476a-4b09-8b14-00f0c9ac7921 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:21.934549 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f0b58062-476a-4b09-8b14-00f0c9ac7921 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:21.934982 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f0b58062-476a-4b09-8b14-00f0c9ac7921 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:21.935664 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f0b58062-476a-4b09-8b14-00f0c9ac7921 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:21.936634 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f0b58062-476a-4b09-8b14-00f0c9ac7921 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:21.937145 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f0b58062-476a-4b09-8b14-00f0c9ac7921 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:21.962968 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f0b58062-476a-4b09-8b14-00f0c9ac7921 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Going to try to terminate instance {{(pid=125553) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 00:50:22.066537 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f0b58062-476a-4b09-8b14-00f0c9ac7921 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 204 len: 0 microversion: 2.1 time: 0.143341 Oct 30 00:50:22.067429 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 156/323] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 00:50:21 2022] DELETE /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 00:50:22.075238 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-94d710c8-6fec-48ab-a839-f5f29c978b91 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:22.075923 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-94d710c8-6fec-48ab-a839-f5f29c978b91 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:22.083118 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-94d710c8-6fec-48ab-a839-f5f29c978b91 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:22.083599 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-94d710c8-6fec-48ab-a839-f5f29c978b91 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:22.084026 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-94d710c8-6fec-48ab-a839-f5f29c978b91 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:22.084931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-94d710c8-6fec-48ab-a839-f5f29c978b91 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:22.085483 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-94d710c8-6fec-48ab-a839-f5f29c978b91 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:22.085902 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-94d710c8-6fec-48ab-a839-f5f29c978b91 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:22.237954 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-94d710c8-6fec-48ab-a839-f5f29c978b91 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:22.248152 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-94d710c8-6fec-48ab-a839-f5f29c978b91 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1555 microversion: 2.1 time: 0.176470 Oct 30 00:50:22.249508 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 168/324] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:22 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:22.783238 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-051a3cf2-fb8a-4cda-badf-b4cedc198483 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:22.784031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-051a3cf2-fb8a-4cda-badf-b4cedc198483 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:22.789845 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-051a3cf2-fb8a-4cda-badf-b4cedc198483 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:22.790322 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-051a3cf2-fb8a-4cda-badf-b4cedc198483 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:22.790755 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-051a3cf2-fb8a-4cda-badf-b4cedc198483 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:22.791441 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-051a3cf2-fb8a-4cda-badf-b4cedc198483 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:22.791896 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-051a3cf2-fb8a-4cda-badf-b4cedc198483 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:22.792335 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-051a3cf2-fb8a-4cda-badf-b4cedc198483 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:22.949904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-051a3cf2-fb8a-4cda-badf-b4cedc198483 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:22.957918 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-051a3cf2-fb8a-4cda-badf-b4cedc198483 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.178890 Oct 30 00:50:22.958475 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 157/325] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:22 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:23.280333 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-886820a8-c49a-44bb-9357-0bd7bc8d0f7b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:23.280938 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-886820a8-c49a-44bb-9357-0bd7bc8d0f7b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:23.286965 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-886820a8-c49a-44bb-9357-0bd7bc8d0f7b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:23.287433 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-886820a8-c49a-44bb-9357-0bd7bc8d0f7b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:23.287861 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-886820a8-c49a-44bb-9357-0bd7bc8d0f7b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:23.288579 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-886820a8-c49a-44bb-9357-0bd7bc8d0f7b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:23.289021 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-886820a8-c49a-44bb-9357-0bd7bc8d0f7b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:23.289432 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-886820a8-c49a-44bb-9357-0bd7bc8d0f7b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:23.293406 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=100 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:23.423028 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-886820a8-c49a-44bb-9357-0bd7bc8d0f7b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:23.431608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-886820a8-c49a-44bb-9357-0bd7bc8d0f7b tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1555 microversion: 2.1 time: 0.163248 Oct 30 00:50:23.432195 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 169/326] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:23 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:23.983895 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-512c1f88-5685-4b92-a715-8131cd7cca12 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:23.984634 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-512c1f88-5685-4b92-a715-8131cd7cca12 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:23.991012 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-512c1f88-5685-4b92-a715-8131cd7cca12 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:23.991482 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-512c1f88-5685-4b92-a715-8131cd7cca12 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:23.991917 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-512c1f88-5685-4b92-a715-8131cd7cca12 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:23.992648 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-512c1f88-5685-4b92-a715-8131cd7cca12 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:23.993099 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-512c1f88-5685-4b92-a715-8131cd7cca12 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:23.993524 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-512c1f88-5685-4b92-a715-8131cd7cca12 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:24.134531 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-512c1f88-5685-4b92-a715-8131cd7cca12 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:24.142942 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-512c1f88-5685-4b92-a715-8131cd7cca12 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.164354 Oct 30 00:50:24.143506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 158/327] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:23 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:24.455410 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-1dddab72-f53f-4170-a30c-bbbf021ed9fc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:24.456009 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-1dddab72-f53f-4170-a30c-bbbf021ed9fc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:24.461833 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1dddab72-f53f-4170-a30c-bbbf021ed9fc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:24.462396 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1dddab72-f53f-4170-a30c-bbbf021ed9fc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:24.462856 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1dddab72-f53f-4170-a30c-bbbf021ed9fc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:24.463591 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1dddab72-f53f-4170-a30c-bbbf021ed9fc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:24.464054 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1dddab72-f53f-4170-a30c-bbbf021ed9fc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:24.464566 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1dddab72-f53f-4170-a30c-bbbf021ed9fc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:24.624433 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-1dddab72-f53f-4170-a30c-bbbf021ed9fc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:24.632595 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-1dddab72-f53f-4170-a30c-bbbf021ed9fc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1555 microversion: 2.1 time: 0.181686 Oct 30 00:50:24.633154 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 170/328] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:24 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:25.166825 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-795e3cd2-6129-4aa8-92c0-e731f2fe8bab tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:25.167550 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-795e3cd2-6129-4aa8-92c0-e731f2fe8bab tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:25.176292 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-795e3cd2-6129-4aa8-92c0-e731f2fe8bab tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:25.176774 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-795e3cd2-6129-4aa8-92c0-e731f2fe8bab tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:25.177214 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-795e3cd2-6129-4aa8-92c0-e731f2fe8bab tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:25.177917 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-795e3cd2-6129-4aa8-92c0-e731f2fe8bab tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:25.178364 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-795e3cd2-6129-4aa8-92c0-e731f2fe8bab tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:25.178958 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-795e3cd2-6129-4aa8-92c0-e731f2fe8bab tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:25.183355 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:25.367700 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-795e3cd2-6129-4aa8-92c0-e731f2fe8bab tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:25.375773 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-795e3cd2-6129-4aa8-92c0-e731f2fe8bab tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.212899 Oct 30 00:50:25.391725 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 159/329] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:25 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:25.630826 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-8b5dc34e-4233-452e-b144-79f7f44f14b5 req-28cd2874-d735-4379-a67a-4e837a0744cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa96626-2d37-41bc-8beb-ed93a5a90f85", "name": "network-vif-deleted", "tag": "b4275094-f698-4ced-a85a-305d1f639c55"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:50:25.648677 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-8b5dc34e-4233-452e-b144-79f7f44f14b5 req-28cd2874-d735-4379-a67a-4e837a0744cc service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:25.649225 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-8b5dc34e-4233-452e-b144-79f7f44f14b5 req-28cd2874-d735-4379-a67a-4e837a0744cc service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:25.649879 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-8b5dc34e-4233-452e-b144-79f7f44f14b5 req-28cd2874-d735-4379-a67a-4e837a0744cc service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:25.657351 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f0d7024f-41df-4e83-aeaf-13390ea22abc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:25.658061 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f0d7024f-41df-4e83-aeaf-13390ea22abc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:25.664709 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f0d7024f-41df-4e83-aeaf-13390ea22abc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:25.668736 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f0d7024f-41df-4e83-aeaf-13390ea22abc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:25.672633 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f0d7024f-41df-4e83-aeaf-13390ea22abc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:25.674538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f0d7024f-41df-4e83-aeaf-13390ea22abc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:25.675009 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f0d7024f-41df-4e83-aeaf-13390ea22abc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:25.675469 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f0d7024f-41df-4e83-aeaf-13390ea22abc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:25.692035 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-8b5dc34e-4233-452e-b144-79f7f44f14b5 req-28cd2874-d735-4379-a67a-4e837a0744cc service nova] Creating event network-vif-deleted:b4275094-f698-4ced-a85a-305d1f639c55 for instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 on hv-cinder-86149 Oct 30 00:50:25.697872 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-8b5dc34e-4233-452e-b144-79f7f44f14b5 req-28cd2874-d735-4379-a67a-4e837a0744cc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075289 Oct 30 00:50:25.699201 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 171/330] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:50:25.785800 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f0d7024f-41df-4e83-aeaf-13390ea22abc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:25.794252 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f0d7024f-41df-4e83-aeaf-13390ea22abc tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1346 microversion: 2.1 time: 0.142002 Oct 30 00:50:25.794812 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 160/331] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:25 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1346 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:50:26.401143 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ac886799-9910-419d-b9c0-daab317fb442 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:26.401831 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ac886799-9910-419d-b9c0-daab317fb442 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:26.410535 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ac886799-9910-419d-b9c0-daab317fb442 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:26.411024 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ac886799-9910-419d-b9c0-daab317fb442 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:26.411451 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ac886799-9910-419d-b9c0-daab317fb442 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:26.412191 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ac886799-9910-419d-b9c0-daab317fb442 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:26.412961 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ac886799-9910-419d-b9c0-daab317fb442 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:26.413078 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ac886799-9910-419d-b9c0-daab317fb442 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:26.582597 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ac886799-9910-419d-b9c0-daab317fb442 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:26.609643 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ac886799-9910-419d-b9c0-daab317fb442 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.212759 Oct 30 00:50:26.610207 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 172/332] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:26 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:26.820457 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-9fd45085-b6c7-46fa-b338-ccb548b2d7f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:26.821113 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-9fd45085-b6c7-46fa-b338-ccb548b2d7f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:26.828887 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9fd45085-b6c7-46fa-b338-ccb548b2d7f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:26.829164 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9fd45085-b6c7-46fa-b338-ccb548b2d7f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:26.829781 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9fd45085-b6c7-46fa-b338-ccb548b2d7f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:26.830804 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9fd45085-b6c7-46fa-b338-ccb548b2d7f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:26.830896 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9fd45085-b6c7-46fa-b338-ccb548b2d7f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:26.831324 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9fd45085-b6c7-46fa-b338-ccb548b2d7f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:26.867454 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9fd45085-b6c7-46fa-b338-ccb548b2d7f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:26.868018 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9fd45085-b6c7-46fa-b338-ccb548b2d7f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:26.874348 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9fd45085-b6c7-46fa-b338-ccb548b2d7f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:26.875271 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.objects.instance [None req-9fd45085-b6c7-46fa-b338-ccb548b2d7f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lazy-loading 'fault' on Instance uuid 3fa96626-2d37-41bc-8beb-ed93a5a90f85 {{(pid=125553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:50:26.927072 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-9fd45085-b6c7-46fa-b338-ccb548b2d7f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8135391c507d4f06aeb7e74160bbd038', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b5b4b97dfd468f923996968764d206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:26.935134 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-9fd45085-b6c7-46fa-b338-ccb548b2d7f5 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 200 len: 1351 microversion: 2.1 time: 0.120941 Oct 30 00:50:26.935781 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 161/333] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:26 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 1351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:50:27.634755 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-49292118-d8c5-4413-9462-dc76b77f24f0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:27.635367 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-49292118-d8c5-4413-9462-dc76b77f24f0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:27.655351 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-49292118-d8c5-4413-9462-dc76b77f24f0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:27.655841 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-49292118-d8c5-4413-9462-dc76b77f24f0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:27.656316 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-49292118-d8c5-4413-9462-dc76b77f24f0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:27.657023 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-49292118-d8c5-4413-9462-dc76b77f24f0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:27.657485 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-49292118-d8c5-4413-9462-dc76b77f24f0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:27.657902 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-49292118-d8c5-4413-9462-dc76b77f24f0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:27.805353 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-49292118-d8c5-4413-9462-dc76b77f24f0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:27.813160 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-49292118-d8c5-4413-9462-dc76b77f24f0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.182376 Oct 30 00:50:27.813898 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 173/334] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:27 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:27.957775 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3c34169f-fa08-4e44-9d6e-60e4c9cab4e2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:27.958455 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-3c34169f-fa08-4e44-9d6e-60e4c9cab4e2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:27.967861 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3c34169f-fa08-4e44-9d6e-60e4c9cab4e2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:27.968365 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3c34169f-fa08-4e44-9d6e-60e4c9cab4e2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:27.968806 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3c34169f-fa08-4e44-9d6e-60e4c9cab4e2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:27.969497 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3c34169f-fa08-4e44-9d6e-60e4c9cab4e2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:27.969930 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3c34169f-fa08-4e44-9d6e-60e4c9cab4e2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:27.970383 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3c34169f-fa08-4e44-9d6e-60e4c9cab4e2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:27.985679 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-3c34169f-fa08-4e44-9d6e-60e4c9cab4e2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] HTTP exception thrown: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. Oct 30 00:50:27.997796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3c34169f-fa08-4e44-9d6e-60e4c9cab4e2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Request method failure captured: Oct 30 00:50:27.997796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 HTTP/1.1 Oct 30 00:50:27.997796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 00:50:27.997796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 00:50:27.997796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 00:50:27.997796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 00:50:27.997796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 00:50:27.997796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 00:50:27.997796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 00:50:27.997796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 00:50:27.997796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXcnbrGtdcTVFcCWSATWlI5F4hFcpw_kjIemaVhi6tRQFGo7E_CdIazqIxWZV-KGRESrDZILlReujl8uSOBatUqYsYTnd4JwKzfoz1ttC6f6sS1XmhSm8pHhRRwTN0WHx-G93SZU6OITUjRypLHtTKkq7mR30dIsl9RC8yuWLstF3zxc Oct 30 00:50:27.997796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 00:50:27.997796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 00:50:27.997796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 00:50:27.997796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 00:50:27.997796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 00:50:27.997796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 00:50:27.997796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: e1b5b4b97dfd468f923996968764d206 Oct 30 00:50:27.997796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-DeleteServersTestJSON-2016475566 Oct 30 00:50:27.997796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 00:50:27.997796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 00:50:28.000807 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e1b5b4b97dfd468f923996968764d206"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1b5b4b97dfd468f923996968764d206"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e1b5b4b97dfd468f923996968764d206"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1b5b4b97dfd468f923996968764d206"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:50:28.000807 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-DeleteServersTestJSON-2016475566 Oct 30 00:50:28.000807 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: e1b5b4b97dfd468f923996968764d206 Oct 30 00:50:28.000807 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-DeleteServersTestJSON-2016475566 Oct 30 00:50:28.000807 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-DeleteServersTestJSON-2016475566-project Oct 30 00:50:28.000807 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 00:50:28.000807 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 00:50:28.000807 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: 8135391c507d4f06aeb7e74160bbd038 Oct 30 00:50:28.000807 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-DeleteServersTestJSON-2016475566-project Oct 30 00:50:28.000807 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: > Oct 30 00:50:28.000807 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. Oct 30 00:50:28.000807 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': '3fa96626-2d37-41bc-8beb-ed93a5a90f85'} Oct 30 00:50:28.001638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:50:28.001638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:50:28.001638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:50:28.001638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:50:28.001638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:50:28.001638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:50:28.001638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:50:28.001638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:50:28.001638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:50:28.001638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:50:28.001638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. Oct 30 00:50:28.001638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:50:28.001638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:50:28.001638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:50:28.001638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:50:28.001638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:50:28.001638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:50:28.001638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:50:28.001638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:50:28.001638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:50:28.002960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:50:28.002960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 00:50:28.002960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 00:50:28.002960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:50:28.002960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:50:28.002960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:50:28.002960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:50:28.002960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. Oct 30 00:50:28.002960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:50:28.002960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:50:28.002960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:50:28.002960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:50:28.002960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:50:28.002960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:50:28.002960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:50:28.002960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:50:28.002960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. Oct 30 00:50:28.002960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:50:28.004184 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3c34169f-fa08-4e44-9d6e-60e4c9cab4e2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Returning 404 to user: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:50:28.004471 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-3c34169f-fa08-4e44-9d6e-60e4c9cab4e2 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 404 len: 111 microversion: 2.1 time: 0.048131 Oct 30 00:50:28.005186 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 162/335] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:27 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 00:50:28.131620 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7b4ae148-7d5d-411f-970e-4a3c7798acec tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:28.133863 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-7b4ae148-7d5d-411f-970e-4a3c7798acec tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:28.140033 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7b4ae148-7d5d-411f-970e-4a3c7798acec tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:28.140558 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7b4ae148-7d5d-411f-970e-4a3c7798acec tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:28.141033 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7b4ae148-7d5d-411f-970e-4a3c7798acec tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:28.141733 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7b4ae148-7d5d-411f-970e-4a3c7798acec tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:28.142185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7b4ae148-7d5d-411f-970e-4a3c7798acec tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:28.142613 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7b4ae148-7d5d-411f-970e-4a3c7798acec tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:28.156478 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-7b4ae148-7d5d-411f-970e-4a3c7798acec tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] HTTP exception thrown: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. Oct 30 00:50:28.171326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7b4ae148-7d5d-411f-970e-4a3c7798acec tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Request method failure captured: Oct 30 00:50:28.171326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85/os-volume_attachments HTTP/1.1 Oct 30 00:50:28.171326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 00:50:28.171326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 00:50:28.171326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 00:50:28.171326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 00:50:28.171326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 00:50:28.171326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 00:50:28.171326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 00:50:28.171326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 00:50:28.171326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcnbrGtdcTVFcCWSATWlI5F4hFcpw_kjIemaVhi6tRQFGo7E_CdIazqIxWZV-KGRESrDZILlReujl8uSOBatUqYsYTnd4JwKzfoz1ttC6f6sS1XmhSm8pHhRRwTN0WHx-G93SZU6OITUjRypLHtTKkq7mR30dIsl9RC8yuWLstF3zxc Oct 30 00:50:28.171326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 00:50:28.171326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 00:50:28.171326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 00:50:28.171326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 00:50:28.171326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 00:50:28.171326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 00:50:28.171326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: e1b5b4b97dfd468f923996968764d206 Oct 30 00:50:28.171326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-DeleteServersTestJSON-2016475566 Oct 30 00:50:28.171326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 00:50:28.171326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 00:50:28.172912 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e1b5b4b97dfd468f923996968764d206"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1b5b4b97dfd468f923996968764d206"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e1b5b4b97dfd468f923996968764d206"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1b5b4b97dfd468f923996968764d206"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:50:28.172912 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-DeleteServersTestJSON-2016475566 Oct 30 00:50:28.172912 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: e1b5b4b97dfd468f923996968764d206 Oct 30 00:50:28.172912 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-DeleteServersTestJSON-2016475566 Oct 30 00:50:28.172912 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-DeleteServersTestJSON-2016475566-project Oct 30 00:50:28.172912 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 00:50:28.172912 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 00:50:28.172912 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 8135391c507d4f06aeb7e74160bbd038 Oct 30 00:50:28.172912 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-DeleteServersTestJSON-2016475566-project Oct 30 00:50:28.172912 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 00:50:28.172912 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. Oct 30 00:50:28.172912 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'server_id': '3fa96626-2d37-41bc-8beb-ed93a5a90f85'} Oct 30 00:50:28.173857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:50:28.173857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:50:28.173857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:50:28.173857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:50:28.173857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:50:28.173857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:50:28.173857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:50:28.173857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:50:28.173857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:50:28.173857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:50:28.173857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. Oct 30 00:50:28.173857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:50:28.173857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:50:28.173857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:50:28.173857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:50:28.173857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:50:28.173857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:50:28.173857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:50:28.173857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:50:28.173857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:50:28.175257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:50:28.175257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 00:50:28.175257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 00:50:28.175257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 30 00:50:28.175257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 00:50:28.175257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 30 00:50:28.175257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 30 00:50:28.175257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:50:28.175257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:50:28.175257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. Oct 30 00:50:28.175257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:50:28.175257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:50:28.175257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:50:28.175257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:50:28.175257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:50:28.175257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:50:28.175257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:50:28.175257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:50:28.175257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. Oct 30 00:50:28.175257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:50:28.176877 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7b4ae148-7d5d-411f-970e-4a3c7798acec tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Returning 404 to user: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:50:28.176877 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7b4ae148-7d5d-411f-970e-4a3c7798acec tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047206 Oct 30 00:50:28.177145 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 174/336] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Oct 30 00:50:28 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85/os-volume_attachments => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 00:50:28.837701 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-10e0da1c-ce5d-48fe-a107-dabe31d16269 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:28.838562 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-10e0da1c-ce5d-48fe-a107-dabe31d16269 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:28.846336 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-10e0da1c-ce5d-48fe-a107-dabe31d16269 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:28.846897 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-10e0da1c-ce5d-48fe-a107-dabe31d16269 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:28.847527 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-10e0da1c-ce5d-48fe-a107-dabe31d16269 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:28.848275 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-10e0da1c-ce5d-48fe-a107-dabe31d16269 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:28.849284 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-10e0da1c-ce5d-48fe-a107-dabe31d16269 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:28.849720 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-10e0da1c-ce5d-48fe-a107-dabe31d16269 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:29.004510 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-10e0da1c-ce5d-48fe-a107-dabe31d16269 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:29.013600 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-10e0da1c-ce5d-48fe-a107-dabe31d16269 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.180158 Oct 30 00:50:29.015079 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 163/337] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:28 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:29.424588 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d18c501c-ed1c-42fe-9f6b-3e44d01880f4 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:29.425065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-d18c501c-ed1c-42fe-9f6b-3e44d01880f4 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:29.430962 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d18c501c-ed1c-42fe-9f6b-3e44d01880f4 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:29.431440 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d18c501c-ed1c-42fe-9f6b-3e44d01880f4 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:29.431870 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d18c501c-ed1c-42fe-9f6b-3e44d01880f4 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:29.432583 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d18c501c-ed1c-42fe-9f6b-3e44d01880f4 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:29.433030 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d18c501c-ed1c-42fe-9f6b-3e44d01880f4 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:29.433444 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d18c501c-ed1c-42fe-9f6b-3e44d01880f4 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:29.447512 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-d18c501c-ed1c-42fe-9f6b-3e44d01880f4 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] HTTP exception thrown: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. Oct 30 00:50:29.449702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d18c501c-ed1c-42fe-9f6b-3e44d01880f4 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Request method failure captured: Oct 30 00:50:29.449702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: DELETE /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 HTTP/1.1 Oct 30 00:50:29.449702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 00:50:29.449702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 00:50:29.449702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 00:50:29.449702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 00:50:29.449702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 00:50:29.449702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 00:50:29.449702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 00:50:29.449702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 00:50:29.449702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcnbrGtdcTVFcCWSATWlI5F4hFcpw_kjIemaVhi6tRQFGo7E_CdIazqIxWZV-KGRESrDZILlReujl8uSOBatUqYsYTnd4JwKzfoz1ttC6f6sS1XmhSm8pHhRRwTN0WHx-G93SZU6OITUjRypLHtTKkq7mR30dIsl9RC8yuWLstF3zxc Oct 30 00:50:29.449702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 00:50:29.449702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 00:50:29.449702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 00:50:29.449702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 00:50:29.449702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 00:50:29.449702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 00:50:29.449702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: e1b5b4b97dfd468f923996968764d206 Oct 30 00:50:29.449702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-DeleteServersTestJSON-2016475566 Oct 30 00:50:29.449702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 00:50:29.449702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 00:50:29.451232 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e1b5b4b97dfd468f923996968764d206"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1b5b4b97dfd468f923996968764d206"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e1b5b4b97dfd468f923996968764d206"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1b5b4b97dfd468f923996968764d206"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:50:29.451232 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-DeleteServersTestJSON-2016475566 Oct 30 00:50:29.451232 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: e1b5b4b97dfd468f923996968764d206 Oct 30 00:50:29.451232 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-DeleteServersTestJSON-2016475566 Oct 30 00:50:29.451232 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-DeleteServersTestJSON-2016475566-project Oct 30 00:50:29.451232 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 00:50:29.451232 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 00:50:29.451232 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 8135391c507d4f06aeb7e74160bbd038 Oct 30 00:50:29.451232 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-DeleteServersTestJSON-2016475566-project Oct 30 00:50:29.451232 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 00:50:29.451232 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. Oct 30 00:50:29.451232 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': '3fa96626-2d37-41bc-8beb-ed93a5a90f85'} Oct 30 00:50:29.452127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:50:29.452127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:50:29.452127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:50:29.452127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:50:29.452127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:50:29.452127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:50:29.452127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:50:29.452127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:50:29.452127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:50:29.452127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:50:29.452127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. Oct 30 00:50:29.452127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:50:29.452127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:50:29.452127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:50:29.452127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:50:29.452127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:50:29.452127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:50:29.452127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:50:29.452127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:50:29.452127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:50:29.453713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:50:29.453713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 00:50:29.453713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 00:50:29.453713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 00:50:29.453713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 00:50:29.453713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:50:29.453713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:50:29.453713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:50:29.453713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:50:29.453713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. Oct 30 00:50:29.453713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:50:29.453713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:50:29.453713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:50:29.453713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:50:29.453713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:50:29.453713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:50:29.453713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:50:29.453713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:50:29.453713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. Oct 30 00:50:29.453713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:50:29.455240 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d18c501c-ed1c-42fe-9f6b-3e44d01880f4 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Returning 404 to user: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:50:29.455240 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-d18c501c-ed1c-42fe-9f6b-3e44d01880f4 tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 404 len: 111 microversion: 2.1 time: 0.030981 Oct 30 00:50:29.455240 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 175/338] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 00:50:29 2022] DELETE /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 00:50:29.460962 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-2e20be9f-df18-495e-8cc7-d363bac9f88d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:29.461642 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-2e20be9f-df18-495e-8cc7-d363bac9f88d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] [instance: 3fa96626-2d37-41bc-8beb-ed93a5a90f85] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:29.469354 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2e20be9f-df18-495e-8cc7-d363bac9f88d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:29.470274 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2e20be9f-df18-495e-8cc7-d363bac9f88d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:29.470274 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2e20be9f-df18-495e-8cc7-d363bac9f88d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:29.470930 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2e20be9f-df18-495e-8cc7-d363bac9f88d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:29.471380 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2e20be9f-df18-495e-8cc7-d363bac9f88d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:29.471798 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2e20be9f-df18-495e-8cc7-d363bac9f88d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:29.486282 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-2e20be9f-df18-495e-8cc7-d363bac9f88d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] HTTP exception thrown: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. Oct 30 00:50:29.487832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-2e20be9f-df18-495e-8cc7-d363bac9f88d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Request method failure captured: Oct 30 00:50:29.487832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 HTTP/1.1 Oct 30 00:50:29.487832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 00:50:29.487832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 00:50:29.487832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 00:50:29.487832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 00:50:29.487832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 00:50:29.487832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 00:50:29.487832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 00:50:29.487832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 00:50:29.487832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXcnbrGtdcTVFcCWSATWlI5F4hFcpw_kjIemaVhi6tRQFGo7E_CdIazqIxWZV-KGRESrDZILlReujl8uSOBatUqYsYTnd4JwKzfoz1ttC6f6sS1XmhSm8pHhRRwTN0WHx-G93SZU6OITUjRypLHtTKkq7mR30dIsl9RC8yuWLstF3zxc Oct 30 00:50:29.487832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 00:50:29.487832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 00:50:29.487832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 00:50:29.487832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 00:50:29.487832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 00:50:29.487832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 00:50:29.487832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: e1b5b4b97dfd468f923996968764d206 Oct 30 00:50:29.487832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-DeleteServersTestJSON-2016475566 Oct 30 00:50:29.487832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 00:50:29.487832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 00:50:29.489331 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e1b5b4b97dfd468f923996968764d206"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1b5b4b97dfd468f923996968764d206"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e1b5b4b97dfd468f923996968764d206"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e1b5b4b97dfd468f923996968764d206"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:50:29.489331 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-DeleteServersTestJSON-2016475566 Oct 30 00:50:29.489331 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: e1b5b4b97dfd468f923996968764d206 Oct 30 00:50:29.489331 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-DeleteServersTestJSON-2016475566 Oct 30 00:50:29.489331 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-DeleteServersTestJSON-2016475566-project Oct 30 00:50:29.489331 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 00:50:29.489331 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 00:50:29.489331 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: 8135391c507d4f06aeb7e74160bbd038 Oct 30 00:50:29.489331 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-DeleteServersTestJSON-2016475566-project Oct 30 00:50:29.489331 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: > Oct 30 00:50:29.489331 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. Oct 30 00:50:29.489331 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': '3fa96626-2d37-41bc-8beb-ed93a5a90f85'} Oct 30 00:50:29.490137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:50:29.490137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:50:29.490137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:50:29.490137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:50:29.490137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:50:29.490137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:50:29.490137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:50:29.490137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:50:29.490137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:50:29.490137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:50:29.490137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. Oct 30 00:50:29.490137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:50:29.490137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:50:29.490137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:50:29.490137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:50:29.490137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:50:29.490137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:50:29.490137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:50:29.490137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:50:29.490137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:50:29.491430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:50:29.491430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 00:50:29.491430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 00:50:29.491430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:50:29.491430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:50:29.491430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:50:29.491430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:50:29.491430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. Oct 30 00:50:29.491430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:50:29.491430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:50:29.491430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:50:29.491430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:50:29.491430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:50:29.491430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:50:29.491430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:50:29.491430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:50:29.491430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. Oct 30 00:50:29.491430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:50:29.492643 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-2e20be9f-df18-495e-8cc7-d363bac9f88d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] Returning 404 to user: Instance 3fa96626-2d37-41bc-8beb-ed93a5a90f85 could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:50:29.492643 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-2e20be9f-df18-495e-8cc7-d363bac9f88d tempest-DeleteServersTestJSON-2016475566 tempest-DeleteServersTestJSON-2016475566-project] 10.222.0.36 "GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85" status: 404 len: 111 microversion: 2.1 time: 0.032130 Oct 30 00:50:29.492643 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 164/339] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:29 2022] GET /compute/v2.1/servers/3fa96626-2d37-41bc-8beb-ed93a5a90f85 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 00:50:30.038807 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ae676c41-b793-464e-884b-dce3b2ae8223 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:30.039406 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ae676c41-b793-464e-884b-dce3b2ae8223 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:30.045502 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ae676c41-b793-464e-884b-dce3b2ae8223 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:30.046089 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ae676c41-b793-464e-884b-dce3b2ae8223 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:30.046531 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ae676c41-b793-464e-884b-dce3b2ae8223 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:30.047225 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ae676c41-b793-464e-884b-dce3b2ae8223 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:30.047676 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ae676c41-b793-464e-884b-dce3b2ae8223 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:30.048119 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ae676c41-b793-464e-884b-dce3b2ae8223 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:30.187030 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ae676c41-b793-464e-884b-dce3b2ae8223 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:30.194990 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ae676c41-b793-464e-884b-dce3b2ae8223 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.160056 Oct 30 00:50:30.195549 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 176/340] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:30 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:31.222642 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-10a0468a-98ad-4920-bbff-d030e8876da7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:31.223829 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-10a0468a-98ad-4920-bbff-d030e8876da7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:31.234125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-10a0468a-98ad-4920-bbff-d030e8876da7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:31.234833 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-10a0468a-98ad-4920-bbff-d030e8876da7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:31.235423 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-10a0468a-98ad-4920-bbff-d030e8876da7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:31.236951 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-10a0468a-98ad-4920-bbff-d030e8876da7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:31.237404 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-10a0468a-98ad-4920-bbff-d030e8876da7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:31.237824 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-10a0468a-98ad-4920-bbff-d030e8876da7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:31.410719 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-10a0468a-98ad-4920-bbff-d030e8876da7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:31.418537 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-10a0468a-98ad-4920-bbff-d030e8876da7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.203851 Oct 30 00:50:31.419341 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 165/341] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:31 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:32.443236 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-745e05cf-573d-42fa-8e60-681ab3bf55aa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:32.444505 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-745e05cf-573d-42fa-8e60-681ab3bf55aa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:32.450648 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-745e05cf-573d-42fa-8e60-681ab3bf55aa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:32.451135 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-745e05cf-573d-42fa-8e60-681ab3bf55aa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:32.451861 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-745e05cf-573d-42fa-8e60-681ab3bf55aa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:32.452871 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-745e05cf-573d-42fa-8e60-681ab3bf55aa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:32.453330 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-745e05cf-573d-42fa-8e60-681ab3bf55aa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:32.453918 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-745e05cf-573d-42fa-8e60-681ab3bf55aa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:32.794360 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-745e05cf-573d-42fa-8e60-681ab3bf55aa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:32.806518 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-745e05cf-573d-42fa-8e60-681ab3bf55aa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.367496 Oct 30 00:50:32.808063 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 177/342] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:32 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:50:33.835322 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e847ab9c-a442-4857-a6b6-1c7ce7ed1961 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:33.836061 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-e847ab9c-a442-4857-a6b6-1c7ce7ed1961 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:33.845292 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e847ab9c-a442-4857-a6b6-1c7ce7ed1961 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:33.846077 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e847ab9c-a442-4857-a6b6-1c7ce7ed1961 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:33.847069 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e847ab9c-a442-4857-a6b6-1c7ce7ed1961 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:33.848268 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e847ab9c-a442-4857-a6b6-1c7ce7ed1961 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:33.848894 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e847ab9c-a442-4857-a6b6-1c7ce7ed1961 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:33.849486 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e847ab9c-a442-4857-a6b6-1c7ce7ed1961 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:34.160588 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-e847ab9c-a442-4857-a6b6-1c7ce7ed1961 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:34.179570 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e847ab9c-a442-4857-a6b6-1c7ce7ed1961 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.340563 Oct 30 00:50:34.196914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 166/343] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:33 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:35.206963 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-0fdaaeab-2b85-4e1e-b665-5a05252d2734 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:35.207757 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-0fdaaeab-2b85-4e1e-b665-5a05252d2734 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:35.215479 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0fdaaeab-2b85-4e1e-b665-5a05252d2734 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:35.216017 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0fdaaeab-2b85-4e1e-b665-5a05252d2734 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:35.216496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0fdaaeab-2b85-4e1e-b665-5a05252d2734 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:35.218470 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0fdaaeab-2b85-4e1e-b665-5a05252d2734 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:35.219170 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0fdaaeab-2b85-4e1e-b665-5a05252d2734 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:35.219801 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0fdaaeab-2b85-4e1e-b665-5a05252d2734 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:35.378331 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-0fdaaeab-2b85-4e1e-b665-5a05252d2734 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:35.386416 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-0fdaaeab-2b85-4e1e-b665-5a05252d2734 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.183700 Oct 30 00:50:35.386974 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 178/344] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:35 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:36.418122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3ced3db3-dcec-4e0e-b5cb-7be494a9d4f5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:36.418723 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-3ced3db3-dcec-4e0e-b5cb-7be494a9d4f5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:36.425713 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3ced3db3-dcec-4e0e-b5cb-7be494a9d4f5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:36.426193 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3ced3db3-dcec-4e0e-b5cb-7be494a9d4f5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:36.426628 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3ced3db3-dcec-4e0e-b5cb-7be494a9d4f5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:36.427434 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3ced3db3-dcec-4e0e-b5cb-7be494a9d4f5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:36.427886 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3ced3db3-dcec-4e0e-b5cb-7be494a9d4f5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:36.428335 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3ced3db3-dcec-4e0e-b5cb-7be494a9d4f5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:36.579414 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3ced3db3-dcec-4e0e-b5cb-7be494a9d4f5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:36.587329 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-3ced3db3-dcec-4e0e-b5cb-7be494a9d4f5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.173018 Oct 30 00:50:36.587883 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 167/345] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:36 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:37.612967 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4f553a07-c9f8-4a3f-b020-44850c788dc5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:37.614198 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-4f553a07-c9f8-4a3f-b020-44850c788dc5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:37.617148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=42 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:37.620914 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4f553a07-c9f8-4a3f-b020-44850c788dc5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:37.621398 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4f553a07-c9f8-4a3f-b020-44850c788dc5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:37.621831 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4f553a07-c9f8-4a3f-b020-44850c788dc5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:37.622522 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4f553a07-c9f8-4a3f-b020-44850c788dc5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:37.622972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4f553a07-c9f8-4a3f-b020-44850c788dc5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:37.623960 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4f553a07-c9f8-4a3f-b020-44850c788dc5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:37.752900 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4f553a07-c9f8-4a3f-b020-44850c788dc5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:37.760494 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-4f553a07-c9f8-4a3f-b020-44850c788dc5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.151453 Oct 30 00:50:37.761039 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 179/346] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:37 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:38.783885 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-86df2e85-bff2-40ec-b3a7-912996774216 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:38.784708 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-86df2e85-bff2-40ec-b3a7-912996774216 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:38.791063 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-86df2e85-bff2-40ec-b3a7-912996774216 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:38.791620 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-86df2e85-bff2-40ec-b3a7-912996774216 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:38.792150 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-86df2e85-bff2-40ec-b3a7-912996774216 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:38.792842 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-86df2e85-bff2-40ec-b3a7-912996774216 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:38.793293 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-86df2e85-bff2-40ec-b3a7-912996774216 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:38.793712 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-86df2e85-bff2-40ec-b3a7-912996774216 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:38.929764 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-86df2e85-bff2-40ec-b3a7-912996774216 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:38.938796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-86df2e85-bff2-40ec-b3a7-912996774216 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.158710 Oct 30 00:50:38.939362 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 168/347] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:38 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:39.963368 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-794a86e4-1cf6-4b62-a192-04b6601d88b4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:39.964161 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-794a86e4-1cf6-4b62-a192-04b6601d88b4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:39.971642 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-794a86e4-1cf6-4b62-a192-04b6601d88b4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:39.972362 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-794a86e4-1cf6-4b62-a192-04b6601d88b4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:39.972870 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-794a86e4-1cf6-4b62-a192-04b6601d88b4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:39.973652 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-794a86e4-1cf6-4b62-a192-04b6601d88b4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:39.974098 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-794a86e4-1cf6-4b62-a192-04b6601d88b4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:39.974587 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-794a86e4-1cf6-4b62-a192-04b6601d88b4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:40.126754 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-794a86e4-1cf6-4b62-a192-04b6601d88b4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:40.134543 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-794a86e4-1cf6-4b62-a192-04b6601d88b4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.175183 Oct 30 00:50:40.135126 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 180/348] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:39 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:41.158918 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-75dfdf39-57f5-43b7-b4a9-1c21c2921e04 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:41.159654 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-75dfdf39-57f5-43b7-b4a9-1c21c2921e04 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:41.166168 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-75dfdf39-57f5-43b7-b4a9-1c21c2921e04 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:41.166809 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-75dfdf39-57f5-43b7-b4a9-1c21c2921e04 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:41.167375 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-75dfdf39-57f5-43b7-b4a9-1c21c2921e04 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:41.168278 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-75dfdf39-57f5-43b7-b4a9-1c21c2921e04 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:41.168798 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-75dfdf39-57f5-43b7-b4a9-1c21c2921e04 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:41.169285 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-75dfdf39-57f5-43b7-b4a9-1c21c2921e04 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:41.308260 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-75dfdf39-57f5-43b7-b4a9-1c21c2921e04 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:41.316842 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-75dfdf39-57f5-43b7-b4a9-1c21c2921e04 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.162410 Oct 30 00:50:41.317398 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 169/349] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:41 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:42.340905 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ed175393-4f31-495d-b033-2e4f07f43713 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:42.341532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ed175393-4f31-495d-b033-2e4f07f43713 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:42.359515 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ed175393-4f31-495d-b033-2e4f07f43713 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:42.359515 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ed175393-4f31-495d-b033-2e4f07f43713 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:42.359515 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ed175393-4f31-495d-b033-2e4f07f43713 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:42.359515 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ed175393-4f31-495d-b033-2e4f07f43713 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:42.359866 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ed175393-4f31-495d-b033-2e4f07f43713 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:42.359866 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ed175393-4f31-495d-b033-2e4f07f43713 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:42.499441 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ed175393-4f31-495d-b033-2e4f07f43713 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:42.506993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ed175393-4f31-495d-b033-2e4f07f43713 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.170332 Oct 30 00:50:42.507542 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 181/350] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:42 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:50:43.530059 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e1ff2775-8763-4ff5-93d4-59877bbbb118 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:43.530694 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-e1ff2775-8763-4ff5-93d4-59877bbbb118 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:43.537079 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e1ff2775-8763-4ff5-93d4-59877bbbb118 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:43.537565 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e1ff2775-8763-4ff5-93d4-59877bbbb118 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:43.538040 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e1ff2775-8763-4ff5-93d4-59877bbbb118 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:43.538732 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e1ff2775-8763-4ff5-93d4-59877bbbb118 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:43.539184 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e1ff2775-8763-4ff5-93d4-59877bbbb118 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:43.539608 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e1ff2775-8763-4ff5-93d4-59877bbbb118 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:43.667027 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-e1ff2775-8763-4ff5-93d4-59877bbbb118 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:43.675393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e1ff2775-8763-4ff5-93d4-59877bbbb118 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.149499 Oct 30 00:50:43.675968 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 170/351] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:43 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:44.698278 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-6fa006c5-e91f-41d4-8899-d80758d46025 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:44.698901 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-6fa006c5-e91f-41d4-8899-d80758d46025 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:44.705196 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6fa006c5-e91f-41d4-8899-d80758d46025 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:44.705670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6fa006c5-e91f-41d4-8899-d80758d46025 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:44.706099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6fa006c5-e91f-41d4-8899-d80758d46025 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:44.706775 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6fa006c5-e91f-41d4-8899-d80758d46025 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:44.707217 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6fa006c5-e91f-41d4-8899-d80758d46025 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:44.707627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6fa006c5-e91f-41d4-8899-d80758d46025 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:44.853768 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6fa006c5-e91f-41d4-8899-d80758d46025 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:44.867103 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-6fa006c5-e91f-41d4-8899-d80758d46025 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.167976 Oct 30 00:50:44.868016 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 182/352] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:44 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:45.891105 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-22a480fb-9b29-44e6-9f97-87f712332ee9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:45.891706 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-22a480fb-9b29-44e6-9f97-87f712332ee9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:45.904381 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-22a480fb-9b29-44e6-9f97-87f712332ee9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:45.904869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-22a480fb-9b29-44e6-9f97-87f712332ee9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:45.905294 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-22a480fb-9b29-44e6-9f97-87f712332ee9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:45.906054 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-22a480fb-9b29-44e6-9f97-87f712332ee9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:45.906506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-22a480fb-9b29-44e6-9f97-87f712332ee9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:45.906918 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-22a480fb-9b29-44e6-9f97-87f712332ee9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:46.047323 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-22a480fb-9b29-44e6-9f97-87f712332ee9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:46.054843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-22a480fb-9b29-44e6-9f97-87f712332ee9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.168150 Oct 30 00:50:46.055388 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 171/353] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:45 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:47.080110 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-cd2f42b7-8810-4c5a-b500-7d2ab6180dd2 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:47.080782 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-cd2f42b7-8810-4c5a-b500-7d2ab6180dd2 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:47.086774 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cd2f42b7-8810-4c5a-b500-7d2ab6180dd2 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:47.087255 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cd2f42b7-8810-4c5a-b500-7d2ab6180dd2 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:47.087680 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cd2f42b7-8810-4c5a-b500-7d2ab6180dd2 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:47.088385 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cd2f42b7-8810-4c5a-b500-7d2ab6180dd2 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:47.088831 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cd2f42b7-8810-4c5a-b500-7d2ab6180dd2 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:47.089356 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cd2f42b7-8810-4c5a-b500-7d2ab6180dd2 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:47.227284 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-cd2f42b7-8810-4c5a-b500-7d2ab6180dd2 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:47.234876 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-cd2f42b7-8810-4c5a-b500-7d2ab6180dd2 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.160216 Oct 30 00:50:47.235427 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 183/354] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:47 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:48.258677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-2fe6b3a2-2ccc-42ac-bc0d-b7b18f5bc6a1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:48.259305 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-2fe6b3a2-2ccc-42ac-bc0d-b7b18f5bc6a1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:48.261604 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:48.267523 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2fe6b3a2-2ccc-42ac-bc0d-b7b18f5bc6a1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:48.268001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2fe6b3a2-2ccc-42ac-bc0d-b7b18f5bc6a1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:48.268457 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2fe6b3a2-2ccc-42ac-bc0d-b7b18f5bc6a1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:48.269142 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2fe6b3a2-2ccc-42ac-bc0d-b7b18f5bc6a1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:48.269589 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2fe6b3a2-2ccc-42ac-bc0d-b7b18f5bc6a1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:48.270006 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2fe6b3a2-2ccc-42ac-bc0d-b7b18f5bc6a1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:48.397605 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-2fe6b3a2-2ccc-42ac-bc0d-b7b18f5bc6a1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:48.405610 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-2fe6b3a2-2ccc-42ac-bc0d-b7b18f5bc6a1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.150790 Oct 30 00:50:48.406166 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 172/355] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:48 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:49.429003 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b1e043ab-2f11-49e2-a4c2-d63cb537d544 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:49.429600 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-b1e043ab-2f11-49e2-a4c2-d63cb537d544 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:49.435440 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b1e043ab-2f11-49e2-a4c2-d63cb537d544 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:49.436809 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b1e043ab-2f11-49e2-a4c2-d63cb537d544 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:49.437146 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b1e043ab-2f11-49e2-a4c2-d63cb537d544 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:49.437821 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b1e043ab-2f11-49e2-a4c2-d63cb537d544 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:49.438264 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b1e043ab-2f11-49e2-a4c2-d63cb537d544 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:49.438674 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b1e043ab-2f11-49e2-a4c2-d63cb537d544 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:49.575024 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b1e043ab-2f11-49e2-a4c2-d63cb537d544 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:49.582690 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b1e043ab-2f11-49e2-a4c2-d63cb537d544 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.157459 Oct 30 00:50:49.583244 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 184/356] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:49 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:50.605910 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-ace22c38-38c8-4937-8796-0b4818bd2060 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:50.606752 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-ace22c38-38c8-4937-8796-0b4818bd2060 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:50.613345 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ace22c38-38c8-4937-8796-0b4818bd2060 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:50.613832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ace22c38-38c8-4937-8796-0b4818bd2060 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:50.614273 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ace22c38-38c8-4937-8796-0b4818bd2060 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:50.614968 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ace22c38-38c8-4937-8796-0b4818bd2060 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:50.615412 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ace22c38-38c8-4937-8796-0b4818bd2060 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:50.615835 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ace22c38-38c8-4937-8796-0b4818bd2060 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:50.758472 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ace22c38-38c8-4937-8796-0b4818bd2060 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:50.767257 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-ace22c38-38c8-4937-8796-0b4818bd2060 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.164944 Oct 30 00:50:50.767911 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 173/357] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:50 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:51.790140 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7c8527ac-08da-4c4b-8206-76dc230bc3b8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:51.790838 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-7c8527ac-08da-4c4b-8206-76dc230bc3b8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:51.797648 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7c8527ac-08da-4c4b-8206-76dc230bc3b8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:51.798365 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7c8527ac-08da-4c4b-8206-76dc230bc3b8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:51.798874 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7c8527ac-08da-4c4b-8206-76dc230bc3b8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:51.799566 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7c8527ac-08da-4c4b-8206-76dc230bc3b8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:51.800017 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7c8527ac-08da-4c4b-8206-76dc230bc3b8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:51.800469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7c8527ac-08da-4c4b-8206-76dc230bc3b8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:51.932943 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7c8527ac-08da-4c4b-8206-76dc230bc3b8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:51.942296 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7c8527ac-08da-4c4b-8206-76dc230bc3b8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.155908 Oct 30 00:50:51.943112 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 185/358] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:51 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:52.968870 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3dd9e7c6-60f8-49b4-b993-9e5f7cddc183 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:52.970164 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-3dd9e7c6-60f8-49b4-b993-9e5f7cddc183 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:52.978180 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3dd9e7c6-60f8-49b4-b993-9e5f7cddc183 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:52.978912 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3dd9e7c6-60f8-49b4-b993-9e5f7cddc183 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:52.979641 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3dd9e7c6-60f8-49b4-b993-9e5f7cddc183 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:52.984431 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3dd9e7c6-60f8-49b4-b993-9e5f7cddc183 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:52.986004 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3dd9e7c6-60f8-49b4-b993-9e5f7cddc183 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:52.986364 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3dd9e7c6-60f8-49b4-b993-9e5f7cddc183 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:53.237030 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3dd9e7c6-60f8-49b4-b993-9e5f7cddc183 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:53.245250 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-3dd9e7c6-60f8-49b4-b993-9e5f7cddc183 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.283118 Oct 30 00:50:53.261035 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 174/359] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:52 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:54.269633 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d3e53ee8-d439-426c-bb6b-5447bbbc0614 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:54.270247 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-d3e53ee8-d439-426c-bb6b-5447bbbc0614 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:54.276517 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d3e53ee8-d439-426c-bb6b-5447bbbc0614 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:54.276999 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d3e53ee8-d439-426c-bb6b-5447bbbc0614 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:54.277428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d3e53ee8-d439-426c-bb6b-5447bbbc0614 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:54.278302 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d3e53ee8-d439-426c-bb6b-5447bbbc0614 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:54.278906 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d3e53ee8-d439-426c-bb6b-5447bbbc0614 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:54.279643 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d3e53ee8-d439-426c-bb6b-5447bbbc0614 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:54.303222 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=89 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:54.572959 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-d3e53ee8-d439-426c-bb6b-5447bbbc0614 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:54.585172 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-d3e53ee8-d439-426c-bb6b-5447bbbc0614 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1521 microversion: 2.1 time: 0.320636 Oct 30 00:50:54.588665 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 186/360] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:54 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:55.614778 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-75972cba-9934-452c-bb27-d5a6f0bd3fff tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:55.617971 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-75972cba-9934-452c-bb27-d5a6f0bd3fff tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:55.632448 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-75972cba-9934-452c-bb27-d5a6f0bd3fff tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:55.634740 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-75972cba-9934-452c-bb27-d5a6f0bd3fff tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:55.635538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-75972cba-9934-452c-bb27-d5a6f0bd3fff tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:55.636728 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-75972cba-9934-452c-bb27-d5a6f0bd3fff tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:55.637479 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-75972cba-9934-452c-bb27-d5a6f0bd3fff tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:55.640305 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-75972cba-9934-452c-bb27-d5a6f0bd3fff tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:55.645292 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=90 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:50:55.789851 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-75972cba-9934-452c-bb27-d5a6f0bd3fff tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:55.798523 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-75972cba-9934-452c-bb27-d5a6f0bd3fff tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1501 microversion: 2.1 time: 0.187542 Oct 30 00:50:55.799089 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 175/361] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:55 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1501 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:55.821440 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-50f7a198-8ffc-47d2-bd13-a53e56f5454e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:55.822042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-50f7a198-8ffc-47d2-bd13-a53e56f5454e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:55.828469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50f7a198-8ffc-47d2-bd13-a53e56f5454e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:55.829007 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50f7a198-8ffc-47d2-bd13-a53e56f5454e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:55.830228 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50f7a198-8ffc-47d2-bd13-a53e56f5454e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:55.831342 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50f7a198-8ffc-47d2-bd13-a53e56f5454e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:55.832015 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50f7a198-8ffc-47d2-bd13-a53e56f5454e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:55.833202 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50f7a198-8ffc-47d2-bd13-a53e56f5454e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:55.992835 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-50f7a198-8ffc-47d2-bd13-a53e56f5454e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:56.000843 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-50f7a198-8ffc-47d2-bd13-a53e56f5454e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1514 microversion: 2.1 time: 0.183404 Oct 30 00:50:56.001817 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 187/362] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:55 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:50:59.679993 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-6e0a2f82-7eb4-4b0a-aa0d-b196ef8b1827 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:50:59.682248 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-6e0a2f82-7eb4-4b0a-aa0d-b196ef8b1827 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:59.688944 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6e0a2f82-7eb4-4b0a-aa0d-b196ef8b1827 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:59.689430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6e0a2f82-7eb4-4b0a-aa0d-b196ef8b1827 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:59.689870 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6e0a2f82-7eb4-4b0a-aa0d-b196ef8b1827 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:59.690816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6e0a2f82-7eb4-4b0a-aa0d-b196ef8b1827 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:59.691269 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6e0a2f82-7eb4-4b0a-aa0d-b196ef8b1827 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:59.691833 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6e0a2f82-7eb4-4b0a-aa0d-b196ef8b1827 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:59.717331 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.objects.instance [None req-6e0a2f82-7eb4-4b0a-aa0d-b196ef8b1827 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lazy-loading 'flavor' on Instance uuid a1bf0cdf-a838-4e0c-a56f-707f90711978 {{(pid=125553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:50:59.794676 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-6e0a2f82-7eb4-4b0a-aa0d-b196ef8b1827 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "POST /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978/action" status: 200 len: 32 microversion: 2.1 time: 0.118505 Oct 30 00:50:59.796296 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 176/363] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Oct 30 00:50:59 2022] POST /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978/action => generated 32 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 00:50:59.805676 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-482b2e63-f167-4880-a379-b674362fb57f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:50:59.806303 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-482b2e63-f167-4880-a379-b674362fb57f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:50:59.813304 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-482b2e63-f167-4880-a379-b674362fb57f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:59.813885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-482b2e63-f167-4880-a379-b674362fb57f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:59.814876 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-482b2e63-f167-4880-a379-b674362fb57f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:59.815914 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-482b2e63-f167-4880-a379-b674362fb57f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:50:59.816373 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-482b2e63-f167-4880-a379-b674362fb57f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:50:59.816803 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-482b2e63-f167-4880-a379-b674362fb57f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:50:59.977307 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-482b2e63-f167-4880-a379-b674362fb57f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:50:59.988396 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-482b2e63-f167-4880-a379-b674362fb57f tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1520 microversion: 2.1 time: 0.186581 Oct 30 00:50:59.989122 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 188/364] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:50:59 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:01.013524 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-78eeb712-34cc-445b-92da-709941f08bae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:01.015686 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-78eeb712-34cc-445b-92da-709941f08bae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:01.034609 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-78eeb712-34cc-445b-92da-709941f08bae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:01.035627 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-78eeb712-34cc-445b-92da-709941f08bae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:01.037119 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-78eeb712-34cc-445b-92da-709941f08bae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:01.039812 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-78eeb712-34cc-445b-92da-709941f08bae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:01.042031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-78eeb712-34cc-445b-92da-709941f08bae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:01.046962 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-78eeb712-34cc-445b-92da-709941f08bae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:01.332698 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-78eeb712-34cc-445b-92da-709941f08bae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:01.344288 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-78eeb712-34cc-445b-92da-709941f08bae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1520 microversion: 2.1 time: 0.336073 Oct 30 00:51:01.349785 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 177/365] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:01 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1520 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:02.376951 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d7267c9d-bf65-4041-8011-f0eec78ac068 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:02.377592 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-d7267c9d-bf65-4041-8011-f0eec78ac068 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:02.383807 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d7267c9d-bf65-4041-8011-f0eec78ac068 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:02.384390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d7267c9d-bf65-4041-8011-f0eec78ac068 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:02.384830 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d7267c9d-bf65-4041-8011-f0eec78ac068 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:02.385720 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d7267c9d-bf65-4041-8011-f0eec78ac068 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:02.386175 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d7267c9d-bf65-4041-8011-f0eec78ac068 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:02.386598 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d7267c9d-bf65-4041-8011-f0eec78ac068 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:02.608221 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-d7267c9d-bf65-4041-8011-f0eec78ac068 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:02.626066 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-d7267c9d-bf65-4041-8011-f0eec78ac068 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1520 microversion: 2.1 time: 0.252356 Oct 30 00:51:02.629740 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 189/366] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:02 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:03.657645 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1b7b67b9-859f-4cf8-969d-957a3f8ecc33 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:03.658422 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1b7b67b9-859f-4cf8-969d-957a3f8ecc33 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:03.664637 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1b7b67b9-859f-4cf8-969d-957a3f8ecc33 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:03.665111 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1b7b67b9-859f-4cf8-969d-957a3f8ecc33 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:03.665714 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1b7b67b9-859f-4cf8-969d-957a3f8ecc33 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:03.666608 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1b7b67b9-859f-4cf8-969d-957a3f8ecc33 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:03.667061 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1b7b67b9-859f-4cf8-969d-957a3f8ecc33 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:03.667595 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1b7b67b9-859f-4cf8-969d-957a3f8ecc33 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:03.825550 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1b7b67b9-859f-4cf8-969d-957a3f8ecc33 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:03.833619 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1b7b67b9-859f-4cf8-969d-957a3f8ecc33 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1520 microversion: 2.1 time: 0.180431 Oct 30 00:51:03.834172 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 178/367] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:03 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:04.857246 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-15ad1caa-6616-4e08-a06c-6006e340a1c9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:04.859235 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-15ad1caa-6616-4e08-a06c-6006e340a1c9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:04.865357 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-15ad1caa-6616-4e08-a06c-6006e340a1c9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:04.865838 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-15ad1caa-6616-4e08-a06c-6006e340a1c9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:04.866453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-15ad1caa-6616-4e08-a06c-6006e340a1c9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:04.867312 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-15ad1caa-6616-4e08-a06c-6006e340a1c9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:04.867763 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-15ad1caa-6616-4e08-a06c-6006e340a1c9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:04.868217 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-15ad1caa-6616-4e08-a06c-6006e340a1c9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:05.005713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-15ad1caa-6616-4e08-a06c-6006e340a1c9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:05.013678 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-15ad1caa-6616-4e08-a06c-6006e340a1c9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1520 microversion: 2.1 time: 0.160712 Oct 30 00:51:05.014870 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 190/368] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:04 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:06.046279 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c2e9ea16-278e-4580-a74a-7d3691a1f407 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:06.050058 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-c2e9ea16-278e-4580-a74a-7d3691a1f407 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:06.060533 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c2e9ea16-278e-4580-a74a-7d3691a1f407 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:06.062343 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c2e9ea16-278e-4580-a74a-7d3691a1f407 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:06.063336 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c2e9ea16-278e-4580-a74a-7d3691a1f407 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:06.064720 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c2e9ea16-278e-4580-a74a-7d3691a1f407 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:06.071583 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c2e9ea16-278e-4580-a74a-7d3691a1f407 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:06.072450 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c2e9ea16-278e-4580-a74a-7d3691a1f407 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:06.235069 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c2e9ea16-278e-4580-a74a-7d3691a1f407 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:06.244201 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c2e9ea16-278e-4580-a74a-7d3691a1f407 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1520 microversion: 2.1 time: 0.207458 Oct 30 00:51:06.244993 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 179/369] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:06 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:07.266917 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-48623ca8-33fa-4fa3-817a-23a5ba2e1a25 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:07.267517 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-48623ca8-33fa-4fa3-817a-23a5ba2e1a25 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:07.273383 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-48623ca8-33fa-4fa3-817a-23a5ba2e1a25 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:07.273858 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-48623ca8-33fa-4fa3-817a-23a5ba2e1a25 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:07.274284 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-48623ca8-33fa-4fa3-817a-23a5ba2e1a25 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:07.274953 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-48623ca8-33fa-4fa3-817a-23a5ba2e1a25 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:07.275399 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-48623ca8-33fa-4fa3-817a-23a5ba2e1a25 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:07.275813 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-48623ca8-33fa-4fa3-817a-23a5ba2e1a25 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:07.408856 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-48623ca8-33fa-4fa3-817a-23a5ba2e1a25 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:07.416892 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-48623ca8-33fa-4fa3-817a-23a5ba2e1a25 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1520 microversion: 2.1 time: 0.153992 Oct 30 00:51:07.417779 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 191/370] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:07 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:08.444106 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-34b717f6-c5c5-4145-a4d1-f23e0dcf733a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:08.445558 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-34b717f6-c5c5-4145-a4d1-f23e0dcf733a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:08.454904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34b717f6-c5c5-4145-a4d1-f23e0dcf733a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:08.455559 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34b717f6-c5c5-4145-a4d1-f23e0dcf733a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:08.456205 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34b717f6-c5c5-4145-a4d1-f23e0dcf733a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:08.456913 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34b717f6-c5c5-4145-a4d1-f23e0dcf733a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:08.457375 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34b717f6-c5c5-4145-a4d1-f23e0dcf733a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:08.457931 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34b717f6-c5c5-4145-a4d1-f23e0dcf733a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:08.592272 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-34b717f6-c5c5-4145-a4d1-f23e0dcf733a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:08.600733 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-34b717f6-c5c5-4145-a4d1-f23e0dcf733a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1520 microversion: 2.1 time: 0.162328 Oct 30 00:51:08.601299 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 180/371] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:08 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:09.626082 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-e731500e-cf4b-4fcd-a166-301286939b00 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:09.627909 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-e731500e-cf4b-4fcd-a166-301286939b00 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:09.634666 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=26 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:09.636357 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e731500e-cf4b-4fcd-a166-301286939b00 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:09.637229 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e731500e-cf4b-4fcd-a166-301286939b00 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:09.637931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e731500e-cf4b-4fcd-a166-301286939b00 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:09.638805 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e731500e-cf4b-4fcd-a166-301286939b00 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:09.639984 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e731500e-cf4b-4fcd-a166-301286939b00 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:09.640644 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e731500e-cf4b-4fcd-a166-301286939b00 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:09.837912 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e731500e-cf4b-4fcd-a166-301286939b00 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:09.846860 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-e731500e-cf4b-4fcd-a166-301286939b00 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1520 microversion: 2.1 time: 0.225854 Oct 30 00:51:09.847533 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 192/372] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:09 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:10.870838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-cb634399-9c0a-48c0-8f3a-91a58b0c9eae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:10.871438 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-cb634399-9c0a-48c0-8f3a-91a58b0c9eae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:10.880694 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cb634399-9c0a-48c0-8f3a-91a58b0c9eae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:10.881181 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cb634399-9c0a-48c0-8f3a-91a58b0c9eae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:10.881615 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cb634399-9c0a-48c0-8f3a-91a58b0c9eae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:10.882338 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cb634399-9c0a-48c0-8f3a-91a58b0c9eae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:10.882814 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cb634399-9c0a-48c0-8f3a-91a58b0c9eae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:10.883235 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cb634399-9c0a-48c0-8f3a-91a58b0c9eae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:11.035346 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-cb634399-9c0a-48c0-8f3a-91a58b0c9eae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:11.045992 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-cb634399-9c0a-48c0-8f3a-91a58b0c9eae tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1500 microversion: 2.1 time: 0.178566 Oct 30 00:51:11.046660 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 181/373] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:10 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1500 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:11.071043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2a2b7533-dcb1-4d3f-8f3d-a9352647d3dc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4b9063b-1377-4921-b15c-ff276355b6e7"}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:51:11.074212 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2a2b7533-dcb1-4d3f-8f3d-a9352647d3dc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:11.096259 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2a2b7533-dcb1-4d3f-8f3d-a9352647d3dc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:11.096955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2a2b7533-dcb1-4d3f-8f3d-a9352647d3dc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:11.097558 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2a2b7533-dcb1-4d3f-8f3d-a9352647d3dc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:11.098929 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2a2b7533-dcb1-4d3f-8f3d-a9352647d3dc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:11.099822 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2a2b7533-dcb1-4d3f-8f3d-a9352647d3dc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:11.100530 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2a2b7533-dcb1-4d3f-8f3d-a9352647d3dc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:11.127972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-2a2b7533-dcb1-4d3f-8f3d-a9352647d3dc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] HTTP exception thrown: Cannot 'attach_volume' instance a1bf0cdf-a838-4e0c-a56f-707f90711978 while it is in vm_state rescued Oct 30 00:51:11.130190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2a2b7533-dcb1-4d3f-8f3d-a9352647d3dc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Request method failure captured: Oct 30 00:51:11.130190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: POST /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978/os-volume_attachments HTTP/1.1 Oct 30 00:51:11.130190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 00:51:11.130190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 00:51:11.130190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 00:51:11.130190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 74 Oct 30 00:51:11.130190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 00:51:11.130190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 00:51:11.130190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 00:51:11.130190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 00:51:11.130190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcncHN2FMp3GekPAJgW2lCHVpFVD1HiGRi_JOqMmQ-PfVilNLgfwWcxx70_iLo4vYd7UAj8igq__hURJYEWmtmOEe5lhexivbbch2YCwcd0s6St00YrnBHRVHxJNmHDYhZsFh2ymNYkM6Kt17ecfK_bdNW7N1EoLE8TulhKSa2LJfPY Oct 30 00:51:11.130190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 00:51:11.130190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 00:51:11.130190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 00:51:11.130190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 00:51:11.130190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 00:51:11.130190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 00:51:11.130190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: 999d27163d544dff836ab7d90355f0d6 Oct 30 00:51:11.130190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-661451104 Oct 30 00:51:11.130190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 00:51:11.130190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 00:51:11.131784 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_999d27163d544dff836ab7d90355f0d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/999d27163d544dff836ab7d90355f0d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/999d27163d544dff836ab7d90355f0d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/999d27163d544dff836ab7d90355f0d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:51:11.131784 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-ServerRescueNegativeTestJSON-661451104 Oct 30 00:51:11.131784 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: 999d27163d544dff836ab7d90355f0d6 Oct 30 00:51:11.131784 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-661451104 Oct 30 00:51:11.131784 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-ServerRescueNegativeTestJSON-661451104-project Oct 30 00:51:11.131784 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 00:51:11.131784 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 00:51:11.131784 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 350f5e4238f448949b2c372aabbfc835 Oct 30 00:51:11.131784 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-ServerRescueNegativeTestJSON-661451104-project Oct 30 00:51:11.131784 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Oct 30 00:51:11.131784 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {"volumeAttachment": {"volumeId": "a4b9063b-1377-4921-b15c-ff276355b6e7"}} Oct 30 00:51:11.131784 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 00:51:11.132732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Cannot 'attach_volume' instance a1bf0cdf-a838-4e0c-a56f-707f90711978 while it is in vm_state rescued Oct 30 00:51:11.132732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'server_id': 'a1bf0cdf-a838-4e0c-a56f-707f90711978', 'body': {'volumeAttachment': {'volumeId': 'a4b9063b-1377-4921-b15c-ff276355b6e7'}}} Oct 30 00:51:11.132732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:51:11.132732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:51:11.132732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 30 00:51:11.132732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 30 00:51:11.132732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 00:51:11.132732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 00:51:11.132732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 30 00:51:11.132732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 30 00:51:11.132732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a1bf0cdf-a838-4e0c-a56f-707f90711978 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 30 00:51:11.132732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:51:11.132732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:51:11.132732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:51:11.132732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:51:11.132732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:51:11.132732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:51:11.132732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:51:11.132732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:51:11.134049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:51:11.134049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:51:11.134049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 00:51:11.134049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 00:51:11.134049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 00:51:11.134049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 00:51:11.134049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 00:51:11.134049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 00:51:11.134049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 30 00:51:11.134049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 30 00:51:11.134049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 30 00:51:11.134049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 30 00:51:11.134049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a1bf0cdf-a838-4e0c-a56f-707f90711978 while it is in vm_state rescued Oct 30 00:51:11.134049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:51:11.134049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:51:11.134049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:51:11.134049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:51:11.134049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:51:11.134049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:51:11.135360 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:51:11.135360 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:51:11.135360 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a1bf0cdf-a838-4e0c-a56f-707f90711978 while it is in vm_state rescued Oct 30 00:51:11.135360 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:51:11.137033 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2a2b7533-dcb1-4d3f-8f3d-a9352647d3dc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Returning 409 to user: Cannot 'attach_volume' instance a1bf0cdf-a838-4e0c-a56f-707f90711978 while it is in vm_state rescued {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:51:11.138236 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2a2b7533-dcb1-4d3f-8f3d-a9352647d3dc tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "POST /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.071561 Oct 30 00:51:11.140370 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 193/374] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Oct 30 00:51:11 2022] POST /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978/os-volume_attachments => generated 152 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 00:51:11.150641 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d39b463e-f039-49d2-8b05-7f54eb294d40 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:51:11.151563 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d39b463e-f039-49d2-8b05-7f54eb294d40 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:11.162912 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d39b463e-f039-49d2-8b05-7f54eb294d40 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:11.163411 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d39b463e-f039-49d2-8b05-7f54eb294d40 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:11.163851 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d39b463e-f039-49d2-8b05-7f54eb294d40 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:11.164589 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d39b463e-f039-49d2-8b05-7f54eb294d40 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:11.165080 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d39b463e-f039-49d2-8b05-7f54eb294d40 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:11.165469 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d39b463e-f039-49d2-8b05-7f54eb294d40 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:11.278608 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d39b463e-f039-49d2-8b05-7f54eb294d40 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "POST /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978/action" status: 202 len: 0 microversion: 2.1 time: 0.133870 Oct 30 00:51:11.279375 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 182/375] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Oct 30 00:51:11 2022] POST /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 00:51:11.287540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-687d3f01-7711-41da-b481-0549102336fe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:11.289633 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-687d3f01-7711-41da-b481-0549102336fe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:11.297614 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-687d3f01-7711-41da-b481-0549102336fe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:11.298971 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-687d3f01-7711-41da-b481-0549102336fe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:11.299590 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-687d3f01-7711-41da-b481-0549102336fe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:11.300513 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-687d3f01-7711-41da-b481-0549102336fe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:11.301046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-687d3f01-7711-41da-b481-0549102336fe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:11.301474 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-687d3f01-7711-41da-b481-0549102336fe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:11.497103 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-687d3f01-7711-41da-b481-0549102336fe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:11.509136 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-687d3f01-7711-41da-b481-0549102336fe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1508 microversion: 2.1 time: 0.225492 Oct 30 00:51:11.509808 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 194/376] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:11 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1508 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:12.534138 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1f2c2005-2820-4d31-a850-b5d0455de02a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:12.534855 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1f2c2005-2820-4d31-a850-b5d0455de02a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:12.540936 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1f2c2005-2820-4d31-a850-b5d0455de02a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:12.541410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1f2c2005-2820-4d31-a850-b5d0455de02a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:12.541866 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1f2c2005-2820-4d31-a850-b5d0455de02a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:12.542547 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1f2c2005-2820-4d31-a850-b5d0455de02a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:12.542991 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1f2c2005-2820-4d31-a850-b5d0455de02a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:12.543408 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1f2c2005-2820-4d31-a850-b5d0455de02a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:12.674849 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1f2c2005-2820-4d31-a850-b5d0455de02a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:12.682642 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1f2c2005-2820-4d31-a850-b5d0455de02a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1508 microversion: 2.1 time: 0.153847 Oct 30 00:51:12.683206 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 183/377] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:12 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:13.706925 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f9a13db1-be98-4a66-b35d-82ab085ef950 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:13.707525 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-f9a13db1-be98-4a66-b35d-82ab085ef950 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:13.713730 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f9a13db1-be98-4a66-b35d-82ab085ef950 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:13.714208 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f9a13db1-be98-4a66-b35d-82ab085ef950 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:13.714640 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f9a13db1-be98-4a66-b35d-82ab085ef950 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:13.715330 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f9a13db1-be98-4a66-b35d-82ab085ef950 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:13.715780 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f9a13db1-be98-4a66-b35d-82ab085ef950 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:13.716256 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f9a13db1-be98-4a66-b35d-82ab085ef950 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:13.845723 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-f9a13db1-be98-4a66-b35d-82ab085ef950 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:13.853348 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-f9a13db1-be98-4a66-b35d-82ab085ef950 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1508 microversion: 2.1 time: 0.150222 Oct 30 00:51:13.853900 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 195/378] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:13 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:14.876620 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d6c4f2be-cf20-42bd-8b25-122ebb656a60 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:14.877232 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d6c4f2be-cf20-42bd-8b25-122ebb656a60 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:14.883601 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d6c4f2be-cf20-42bd-8b25-122ebb656a60 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:14.884097 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d6c4f2be-cf20-42bd-8b25-122ebb656a60 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:14.884567 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d6c4f2be-cf20-42bd-8b25-122ebb656a60 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:14.885249 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d6c4f2be-cf20-42bd-8b25-122ebb656a60 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:14.885698 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d6c4f2be-cf20-42bd-8b25-122ebb656a60 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:14.886117 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d6c4f2be-cf20-42bd-8b25-122ebb656a60 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:15.020773 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d6c4f2be-cf20-42bd-8b25-122ebb656a60 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:15.028632 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d6c4f2be-cf20-42bd-8b25-122ebb656a60 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1508 microversion: 2.1 time: 0.155913 Oct 30 00:51:15.029184 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 184/379] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:14 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:16.052744 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-08c070b1-1af9-427b-8dd9-e701b3e21392 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:16.053345 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-08c070b1-1af9-427b-8dd9-e701b3e21392 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:16.059356 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-08c070b1-1af9-427b-8dd9-e701b3e21392 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:16.059824 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-08c070b1-1af9-427b-8dd9-e701b3e21392 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:16.060276 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-08c070b1-1af9-427b-8dd9-e701b3e21392 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:16.060952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-08c070b1-1af9-427b-8dd9-e701b3e21392 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:16.062144 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-08c070b1-1af9-427b-8dd9-e701b3e21392 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:16.062566 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-08c070b1-1af9-427b-8dd9-e701b3e21392 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:16.187973 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-08c070b1-1af9-427b-8dd9-e701b3e21392 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:16.196233 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-08c070b1-1af9-427b-8dd9-e701b3e21392 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1508 microversion: 2.1 time: 0.147321 Oct 30 00:51:16.196783 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 196/380] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:16 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:17.220552 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-b91c1fb2-1155-4661-8498-9059025cdfb8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:17.221161 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-b91c1fb2-1155-4661-8498-9059025cdfb8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:17.227995 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b91c1fb2-1155-4661-8498-9059025cdfb8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:17.228517 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b91c1fb2-1155-4661-8498-9059025cdfb8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:17.228953 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b91c1fb2-1155-4661-8498-9059025cdfb8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:17.229654 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b91c1fb2-1155-4661-8498-9059025cdfb8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:17.230110 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b91c1fb2-1155-4661-8498-9059025cdfb8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:17.230538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b91c1fb2-1155-4661-8498-9059025cdfb8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:17.365115 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-b91c1fb2-1155-4661-8498-9059025cdfb8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:17.372672 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-b91c1fb2-1155-4661-8498-9059025cdfb8 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1508 microversion: 2.1 time: 0.156163 Oct 30 00:51:17.373223 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 185/381] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:17 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:18.395443 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-72b26ad0-af10-463f-bc7a-567c2975f951 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:18.396047 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-72b26ad0-af10-463f-bc7a-567c2975f951 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:18.401904 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-72b26ad0-af10-463f-bc7a-567c2975f951 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:18.402376 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-72b26ad0-af10-463f-bc7a-567c2975f951 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:18.402802 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-72b26ad0-af10-463f-bc7a-567c2975f951 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:18.403480 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-72b26ad0-af10-463f-bc7a-567c2975f951 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:18.403929 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-72b26ad0-af10-463f-bc7a-567c2975f951 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:18.404376 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-72b26ad0-af10-463f-bc7a-567c2975f951 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:18.531295 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-72b26ad0-af10-463f-bc7a-567c2975f951 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:18.538795 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-72b26ad0-af10-463f-bc7a-567c2975f951 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1508 microversion: 2.1 time: 0.147143 Oct 30 00:51:18.539351 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 197/382] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:18 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:19.563126 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-fa41d355-13ad-40d6-b930-f745d27957c0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:19.563637 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-fa41d355-13ad-40d6-b930-f745d27957c0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:19.566290 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=28 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:19.571478 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fa41d355-13ad-40d6-b930-f745d27957c0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:19.571949 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fa41d355-13ad-40d6-b930-f745d27957c0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:19.572406 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fa41d355-13ad-40d6-b930-f745d27957c0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:19.573088 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fa41d355-13ad-40d6-b930-f745d27957c0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:19.573534 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fa41d355-13ad-40d6-b930-f745d27957c0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:19.573948 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fa41d355-13ad-40d6-b930-f745d27957c0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:19.701683 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fa41d355-13ad-40d6-b930-f745d27957c0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:19.709872 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-fa41d355-13ad-40d6-b930-f745d27957c0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1508 microversion: 2.1 time: 0.151181 Oct 30 00:51:19.710428 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 186/383] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:19 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:20.732923 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2256d027-099e-4666-bf6a-c1aa02bc83e3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:20.733621 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2256d027-099e-4666-bf6a-c1aa02bc83e3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:20.740064 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2256d027-099e-4666-bf6a-c1aa02bc83e3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:20.740568 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2256d027-099e-4666-bf6a-c1aa02bc83e3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:20.740999 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2256d027-099e-4666-bf6a-c1aa02bc83e3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:20.741681 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2256d027-099e-4666-bf6a-c1aa02bc83e3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:20.742129 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2256d027-099e-4666-bf6a-c1aa02bc83e3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:20.742546 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2256d027-099e-4666-bf6a-c1aa02bc83e3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:20.873784 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2256d027-099e-4666-bf6a-c1aa02bc83e3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:20.882128 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2256d027-099e-4666-bf6a-c1aa02bc83e3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1508 microversion: 2.1 time: 0.152970 Oct 30 00:51:20.882700 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 198/384] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:20 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:21.908660 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c656db30-d4a9-4bce-9823-d4bcc21b5927 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:21.909262 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-c656db30-d4a9-4bce-9823-d4bcc21b5927 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:21.915647 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c656db30-d4a9-4bce-9823-d4bcc21b5927 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:21.916157 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c656db30-d4a9-4bce-9823-d4bcc21b5927 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:21.916584 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c656db30-d4a9-4bce-9823-d4bcc21b5927 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:21.917271 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c656db30-d4a9-4bce-9823-d4bcc21b5927 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:21.917725 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c656db30-d4a9-4bce-9823-d4bcc21b5927 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:21.918134 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c656db30-d4a9-4bce-9823-d4bcc21b5927 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:22.066276 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c656db30-d4a9-4bce-9823-d4bcc21b5927 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:22.074997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c656db30-d4a9-4bce-9823-d4bcc21b5927 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1508 microversion: 2.1 time: 0.171567 Oct 30 00:51:22.075558 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 187/385] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:21 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:23.098286 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b18d4938-d474-4650-b6c0-c0a069aa05a0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:23.098898 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-b18d4938-d474-4650-b6c0-c0a069aa05a0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:23.104995 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b18d4938-d474-4650-b6c0-c0a069aa05a0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:23.105866 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b18d4938-d474-4650-b6c0-c0a069aa05a0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:23.106830 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b18d4938-d474-4650-b6c0-c0a069aa05a0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:23.108007 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b18d4938-d474-4650-b6c0-c0a069aa05a0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:23.108491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b18d4938-d474-4650-b6c0-c0a069aa05a0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:23.109270 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b18d4938-d474-4650-b6c0-c0a069aa05a0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:23.257645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b18d4938-d474-4650-b6c0-c0a069aa05a0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:23.266374 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b18d4938-d474-4650-b6c0-c0a069aa05a0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1508 microversion: 2.1 time: 0.171761 Oct 30 00:51:23.266831 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 199/386] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:23 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:24.290320 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f03186dc-88cf-443e-bd21-43e39cb39393 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:24.290922 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f03186dc-88cf-443e-bd21-43e39cb39393 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:24.297486 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f03186dc-88cf-443e-bd21-43e39cb39393 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:24.297987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f03186dc-88cf-443e-bd21-43e39cb39393 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:24.298418 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f03186dc-88cf-443e-bd21-43e39cb39393 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:24.299100 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f03186dc-88cf-443e-bd21-43e39cb39393 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:24.299549 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f03186dc-88cf-443e-bd21-43e39cb39393 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:24.299966 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f03186dc-88cf-443e-bd21-43e39cb39393 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:24.429865 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f03186dc-88cf-443e-bd21-43e39cb39393 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:24.432263 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:24.439779 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f03186dc-88cf-443e-bd21-43e39cb39393 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1508 microversion: 2.1 time: 0.153303 Oct 30 00:51:24.440373 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 188/387] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:24 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:51:25.462613 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ba040f1c-f94a-46b4-a13f-296a828d4bac tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:25.463446 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ba040f1c-f94a-46b4-a13f-296a828d4bac tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:25.470266 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ba040f1c-f94a-46b4-a13f-296a828d4bac tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:25.470868 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ba040f1c-f94a-46b4-a13f-296a828d4bac tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:25.471227 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ba040f1c-f94a-46b4-a13f-296a828d4bac tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:25.471947 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ba040f1c-f94a-46b4-a13f-296a828d4bac tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:25.472464 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ba040f1c-f94a-46b4-a13f-296a828d4bac tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:25.472882 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ba040f1c-f94a-46b4-a13f-296a828d4bac tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:25.476097 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=82 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:25.607013 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ba040f1c-f94a-46b4-a13f-296a828d4bac tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:25.615471 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ba040f1c-f94a-46b4-a13f-296a828d4bac tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1508 microversion: 2.1 time: 0.156763 Oct 30 00:51:25.616030 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 200/388] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:25 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:26.638110 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e2230551-9769-4599-9b23-0f493510bded tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:26.638714 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-e2230551-9769-4599-9b23-0f493510bded tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:26.646579 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e2230551-9769-4599-9b23-0f493510bded tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:26.647067 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e2230551-9769-4599-9b23-0f493510bded tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:26.647501 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e2230551-9769-4599-9b23-0f493510bded tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:26.648211 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e2230551-9769-4599-9b23-0f493510bded tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:26.648661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e2230551-9769-4599-9b23-0f493510bded tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:26.649079 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e2230551-9769-4599-9b23-0f493510bded tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:26.775864 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-e2230551-9769-4599-9b23-0f493510bded tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:26.784751 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e2230551-9769-4599-9b23-0f493510bded tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1508 microversion: 2.1 time: 0.150436 Oct 30 00:51:26.785308 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 189/389] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:26 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:27.808234 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-3d460fc6-c672-4896-b872-a7b6d7438f57 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:27.808791 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-3d460fc6-c672-4896-b872-a7b6d7438f57 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:27.815707 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3d460fc6-c672-4896-b872-a7b6d7438f57 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:27.816519 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3d460fc6-c672-4896-b872-a7b6d7438f57 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:27.816956 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3d460fc6-c672-4896-b872-a7b6d7438f57 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:27.817645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3d460fc6-c672-4896-b872-a7b6d7438f57 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:27.818099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3d460fc6-c672-4896-b872-a7b6d7438f57 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:27.818562 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3d460fc6-c672-4896-b872-a7b6d7438f57 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:27.950465 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-3d460fc6-c672-4896-b872-a7b6d7438f57 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:27.958836 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-3d460fc6-c672-4896-b872-a7b6d7438f57 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1508 microversion: 2.1 time: 0.155035 Oct 30 00:51:27.959397 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 201/390] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:27 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:51:28.981870 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-33012f22-fbfb-4984-8f46-8e533b8ea829 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:28.982473 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-33012f22-fbfb-4984-8f46-8e533b8ea829 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:28.989992 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-33012f22-fbfb-4984-8f46-8e533b8ea829 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:28.990475 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-33012f22-fbfb-4984-8f46-8e533b8ea829 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:28.990908 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-33012f22-fbfb-4984-8f46-8e533b8ea829 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:28.991604 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-33012f22-fbfb-4984-8f46-8e533b8ea829 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:28.992052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-33012f22-fbfb-4984-8f46-8e533b8ea829 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:28.992504 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-33012f22-fbfb-4984-8f46-8e533b8ea829 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:29.130595 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-33012f22-fbfb-4984-8f46-8e533b8ea829 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:29.141617 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-33012f22-fbfb-4984-8f46-8e533b8ea829 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1514 microversion: 2.1 time: 0.163486 Oct 30 00:51:29.142187 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 190/391] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:28 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:34.716921 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-5d4e6420-b294-4ab3-88a0-aff5de0bd7aa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Action: 'create', calling method: .version_select at 0x7faf75d59310>, body: {"keypair": {"name": "tempest-keypair-67297937", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFmrMvSTd8LPT6hPFkefi65XS52r8C0EVTSD3h9HvoYRUtPCp98H7X0L8kmEdm+JR55M/hNeYkPKmWhUn7vk7l/E47uBGuzxHHKV9XCVXWyxE1djd0KTjLgvEq0hF9ogQ=="}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:51:34.735247 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-5d4e6420-b294-4ab3-88a0-aff5de0bd7aa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Getting quotas for project 999d27163d544dff836ab7d90355f0d6. Resources: {'key_pairs'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 00:51:34.739433 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-5d4e6420-b294-4ab3-88a0-aff5de0bd7aa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Getting quotas for user 350f5e4238f448949b2c372aabbfc835 and project 999d27163d544dff836ab7d90355f0d6. Resources: {'key_pairs'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 00:51:34.752287 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5d4e6420-b294-4ab3-88a0-aff5de0bd7aa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [4a438619-7209-441e-90bf-c0ffca06cbc2] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 30 00:51:35.760925 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO oslo.messaging._drivers.impl_rabbit [None req-5d4e6420-b294-4ab3-88a0-aff5de0bd7aa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [4a438619-7209-441e-90bf-c0ffca06cbc2] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 60712. Oct 30 00:51:35.782430 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-5d4e6420-b294-4ab3-88a0-aff5de0bd7aa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 1.069104 Oct 30 00:51:35.783039 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 202/392] 10.222.0.36 () {60 vars in 1159 bytes} [Sun Oct 30 00:51:34 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 00:51:37.905913 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-6c1c65b5-7387-47a2-97b8-f9f20a4a4d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1762534004", "imageRef": "27983dee-4bd6-4aad-9c28-22bd5382709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a09af5e2-1845-4aed-bafe-f78c90792385"}], "security_groups": [{"name": "tempest-securitygroup--1693918121"}], "key_name": "tempest-keypair-67297937", "user_data": "}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:51:38.024656 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.network.neutron [None req-6c1c65b5-7387-47a2-97b8-f9f20a4a4d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] validate_networks() for [('a09af5e2-1845-4aed-bafe-f78c90792385', None, None, None, None, None)] {{(pid=125553) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 00:51:38.442051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-6c1c65b5-7387-47a2-97b8-f9f20a4a4d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Flavor limits 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 00:51:38.442605 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-6c1c65b5-7387-47a2-97b8-f9f20a4a4d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Image limits 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 00:51:38.443346 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-6c1c65b5-7387-47a2-97b8-f9f20a4a4d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Flavor pref 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 00:51:38.443970 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-6c1c65b5-7387-47a2-97b8-f9f20a4a4d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Image pref 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 00:51:38.444497 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-6c1c65b5-7387-47a2-97b8-f9f20a4a4d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 00:51:38.463204 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6c1c65b5-7387-47a2-97b8-f9f20a4a4d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:38.463881 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6c1c65b5-7387-47a2-97b8-f9f20a4a4d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:38.464338 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6c1c65b5-7387-47a2-97b8-f9f20a4a4d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:38.465059 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6c1c65b5-7387-47a2-97b8-f9f20a4a4d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:38.465505 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6c1c65b5-7387-47a2-97b8-f9f20a4a4d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:38.466012 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6c1c65b5-7387-47a2-97b8-f9f20a4a4d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:38.483008 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-6c1c65b5-7387-47a2-97b8-f9f20a4a4d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Getting quotas for project 999d27163d544dff836ab7d90355f0d6. Resources: {'instances', 'cores', 'ram'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 00:51:38.487021 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-6c1c65b5-7387-47a2-97b8-f9f20a4a4d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Getting quotas for user 350f5e4238f448949b2c372aabbfc835 and project 999d27163d544dff836ab7d90355f0d6. Resources: {'instances', 'cores', 'ram'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 00:51:38.497869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-6c1c65b5-7387-47a2-97b8-f9f20a4a4d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Going to run 1 instances... {{(pid=125553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 00:51:38.500816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-6c1c65b5-7387-47a2-97b8-f9f20a4a4d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27983dee-4bd6-4aad-9c28-22bd5382709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 00:51:38.544541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6c1c65b5-7387-47a2-97b8-f9f20a4a4d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [91bdfbc4-c33d-4e2b-92eb-fb3befb2de5f] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 30 00:51:39.555215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO oslo.messaging._drivers.impl_rabbit [None req-6c1c65b5-7387-47a2-97b8-f9f20a4a4d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [91bdfbc4-c33d-4e2b-92eb-fb3befb2de5f] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 60856. Oct 30 00:51:39.559992 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-6c1c65b5-7387-47a2-97b8-f9f20a4a4d83 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.659200 Oct 30 00:51:39.561057 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 191/393] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Oct 30 00:51:37 2022] POST /compute/v2.1/servers => generated 409 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 00:51:39.570706 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=11 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:39.575887 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2ba208e3-a2b1-45a3-9bef-8f62726e6087 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:39.576555 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2ba208e3-a2b1-45a3-9bef-8f62726e6087 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:39.660240 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2ba208e3-a2b1-45a3-9bef-8f62726e6087 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:39.671060 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2ba208e3-a2b1-45a3-9bef-8f62726e6087 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1244 microversion: 2.1 time: 0.100760 Oct 30 00:51:39.680602 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 203/394] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:39 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1244 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:40.699034 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-99cf44d3-4766-47a9-98bc-b2a6df6790ba tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:40.699649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-99cf44d3-4766-47a9-98bc-b2a6df6790ba tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:40.754275 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-99cf44d3-4766-47a9-98bc-b2a6df6790ba tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:40.761159 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-99cf44d3-4766-47a9-98bc-b2a6df6790ba tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1244 microversion: 2.1 time: 0.066421 Oct 30 00:51:40.761799 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 192/395] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:40 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1244 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:41.785869 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-319d785b-a277-4713-9bd1-3fbed12bf85c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:41.786550 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-319d785b-a277-4713-9bd1-3fbed12bf85c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:41.789289 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:41.850974 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-319d785b-a277-4713-9bd1-3fbed12bf85c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:41.865801 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-319d785b-a277-4713-9bd1-3fbed12bf85c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1244 microversion: 2.1 time: 0.083590 Oct 30 00:51:41.866376 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 204/396] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:41 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:42.893419 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-b6055a0e-adcd-465a-b168-390f3b6fd206 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:42.895395 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-b6055a0e-adcd-465a-b168-390f3b6fd206 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:42.960806 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-b6055a0e-adcd-465a-b168-390f3b6fd206 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:42.969100 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-b6055a0e-adcd-465a-b168-390f3b6fd206 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1244 microversion: 2.1 time: 0.080125 Oct 30 00:51:42.969657 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 193/397] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:42 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1244 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:43.993328 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-daa6fe31-b355-45b6-96d7-2f2910192fc5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:43.994015 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-daa6fe31-b355-45b6-96d7-2f2910192fc5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:44.001626 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-daa6fe31-b355-45b6-96d7-2f2910192fc5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:44.002106 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-daa6fe31-b355-45b6-96d7-2f2910192fc5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:44.002529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-daa6fe31-b355-45b6-96d7-2f2910192fc5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:44.003214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-daa6fe31-b355-45b6-96d7-2f2910192fc5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:44.003664 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-daa6fe31-b355-45b6-96d7-2f2910192fc5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:44.004100 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-daa6fe31-b355-45b6-96d7-2f2910192fc5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:44.069973 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-daa6fe31-b355-45b6-96d7-2f2910192fc5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:44.079750 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-daa6fe31-b355-45b6-96d7-2f2910192fc5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1248 microversion: 2.1 time: 0.090311 Oct 30 00:51:44.080338 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 205/398] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:43 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1248 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:45.102588 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d2139d02-5303-45ad-b38d-d75f2fded509 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:45.103219 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d2139d02-5303-45ad-b38d-d75f2fded509 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:45.111617 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d2139d02-5303-45ad-b38d-d75f2fded509 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:45.112205 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d2139d02-5303-45ad-b38d-d75f2fded509 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:45.112733 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d2139d02-5303-45ad-b38d-d75f2fded509 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:45.113439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d2139d02-5303-45ad-b38d-d75f2fded509 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:45.113890 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d2139d02-5303-45ad-b38d-d75f2fded509 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:45.114311 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d2139d02-5303-45ad-b38d-d75f2fded509 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:45.116688 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-64de0259-62ec-4195-8810-b8bd39a85801 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-990316311", "imageRef": "27983dee-4bd6-4aad-9c28-22bd5382709a", "flavorRef": "452", "networks": [{"uuid": "caee7172-f4a0-4049-8fe3-0d4fd05999a0"}]}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:51:45.171559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.network.neutron [None req-64de0259-62ec-4195-8810-b8bd39a85801 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] validate_networks() for [('caee7172-f4a0-4049-8fe3-0d4fd05999a0', None, None, None, None, None)] {{(pid=125554) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 00:51:45.183343 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d2139d02-5303-45ad-b38d-d75f2fded509 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:45.191485 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d2139d02-5303-45ad-b38d-d75f2fded509 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1302 microversion: 2.1 time: 0.092589 Oct 30 00:51:45.192337 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 194/399] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:45 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:45.517020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-64de0259-62ec-4195-8810-b8bd39a85801 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Flavor limits 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 00:51:45.517441 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-64de0259-62ec-4195-8810-b8bd39a85801 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Image limits 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 00:51:45.517910 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-64de0259-62ec-4195-8810-b8bd39a85801 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Flavor pref 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 00:51:45.518316 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-64de0259-62ec-4195-8810-b8bd39a85801 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Image pref 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 00:51:45.518778 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-64de0259-62ec-4195-8810-b8bd39a85801 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 00:51:45.527528 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64de0259-62ec-4195-8810-b8bd39a85801 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:45.527994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64de0259-62ec-4195-8810-b8bd39a85801 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:45.528447 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64de0259-62ec-4195-8810-b8bd39a85801 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:45.529166 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64de0259-62ec-4195-8810-b8bd39a85801 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:45.529660 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64de0259-62ec-4195-8810-b8bd39a85801 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:45.530753 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64de0259-62ec-4195-8810-b8bd39a85801 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:45.546911 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-64de0259-62ec-4195-8810-b8bd39a85801 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Getting quotas for project 68d0e30075684bc9a0d40d779c1ad73f. Resources: {'instances', 'cores', 'ram'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 00:51:45.550830 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-64de0259-62ec-4195-8810-b8bd39a85801 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Getting quotas for user 4b3fa11eb591443e85f7317b6dc9b304 and project 68d0e30075684bc9a0d40d779c1ad73f. Resources: {'instances', 'cores', 'ram'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 00:51:45.561720 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-64de0259-62ec-4195-8810-b8bd39a85801 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Going to run 1 instances... {{(pid=125554) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 00:51:45.563953 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-64de0259-62ec-4195-8810-b8bd39a85801 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27983dee-4bd6-4aad-9c28-22bd5382709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125554) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 00:51:45.612155 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR oslo.messaging._drivers.impl_rabbit [None req-64de0259-62ec-4195-8810-b8bd39a85801 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [67e03c1e-2784-4c3e-a453-ebdddbb0009e] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 30 00:51:46.214766 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-68bc6be1-65c5-4407-bc94-bfc88a8808fa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:46.215399 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-68bc6be1-65c5-4407-bc94-bfc88a8808fa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:46.221853 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-68bc6be1-65c5-4407-bc94-bfc88a8808fa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:46.222339 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-68bc6be1-65c5-4407-bc94-bfc88a8808fa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:46.222772 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-68bc6be1-65c5-4407-bc94-bfc88a8808fa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:46.223458 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-68bc6be1-65c5-4407-bc94-bfc88a8808fa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:46.223907 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-68bc6be1-65c5-4407-bc94-bfc88a8808fa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:46.224353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-68bc6be1-65c5-4407-bc94-bfc88a8808fa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:46.290377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-68bc6be1-65c5-4407-bc94-bfc88a8808fa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:46.299117 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-68bc6be1-65c5-4407-bc94-bfc88a8808fa tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1302 microversion: 2.1 time: 0.088312 Oct 30 00:51:46.299674 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 195/400] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:46 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1302 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:51:46.619511 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO oslo.messaging._drivers.impl_rabbit [None req-64de0259-62ec-4195-8810-b8bd39a85801 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [67e03c1e-2784-4c3e-a453-ebdddbb0009e] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 60982. Oct 30 00:51:46.623439 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-64de0259-62ec-4195-8810-b8bd39a85801 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.510503 Oct 30 00:51:46.624162 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 206/401] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Oct 30 00:51:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 00:51:46.635542 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-8073afb7-3048-4f25-a8a7-31462e577400 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:46.636161 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-8073afb7-3048-4f25-a8a7-31462e577400 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:46.691340 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8073afb7-3048-4f25-a8a7-31462e577400 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:46.699699 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-8073afb7-3048-4f25-a8a7-31462e577400 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 200 len: 1218 microversion: 2.1 time: 0.068056 Oct 30 00:51:46.700856 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 196/402] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:46 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:47.321865 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-02a8d86c-ce7d-4405-8736-dc52cbd5aad3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:47.322462 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-02a8d86c-ce7d-4405-8736-dc52cbd5aad3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:47.330786 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-02a8d86c-ce7d-4405-8736-dc52cbd5aad3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:47.331263 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-02a8d86c-ce7d-4405-8736-dc52cbd5aad3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:47.331690 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-02a8d86c-ce7d-4405-8736-dc52cbd5aad3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:47.332409 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-02a8d86c-ce7d-4405-8736-dc52cbd5aad3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:47.332854 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-02a8d86c-ce7d-4405-8736-dc52cbd5aad3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:47.333268 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-02a8d86c-ce7d-4405-8736-dc52cbd5aad3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:47.393709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-02a8d86c-ce7d-4405-8736-dc52cbd5aad3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:47.401260 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-02a8d86c-ce7d-4405-8736-dc52cbd5aad3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1302 microversion: 2.1 time: 0.083271 Oct 30 00:51:47.401765 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 207/403] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:47 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1302 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:47.722546 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e688c6c4-8d9e-485d-9b96-bf92bf0faacf tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:47.723155 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-e688c6c4-8d9e-485d-9b96-bf92bf0faacf tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:47.730172 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e688c6c4-8d9e-485d-9b96-bf92bf0faacf tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:47.730652 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e688c6c4-8d9e-485d-9b96-bf92bf0faacf tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:47.731084 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e688c6c4-8d9e-485d-9b96-bf92bf0faacf tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:47.731777 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e688c6c4-8d9e-485d-9b96-bf92bf0faacf tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:47.732279 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e688c6c4-8d9e-485d-9b96-bf92bf0faacf tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:47.732704 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e688c6c4-8d9e-485d-9b96-bf92bf0faacf tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:47.793852 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-e688c6c4-8d9e-485d-9b96-bf92bf0faacf tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:47.802392 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e688c6c4-8d9e-485d-9b96-bf92bf0faacf tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 200 len: 1222 microversion: 2.1 time: 0.083808 Oct 30 00:51:47.802945 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 197/404] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:47 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:48.424477 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-64468a25-6929-4dd5-b71b-119a79096ce0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:48.425079 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-64468a25-6929-4dd5-b71b-119a79096ce0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:48.431011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64468a25-6929-4dd5-b71b-119a79096ce0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:48.431527 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64468a25-6929-4dd5-b71b-119a79096ce0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:48.432009 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64468a25-6929-4dd5-b71b-119a79096ce0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:48.432722 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64468a25-6929-4dd5-b71b-119a79096ce0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:48.433214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64468a25-6929-4dd5-b71b-119a79096ce0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:48.433692 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-64468a25-6929-4dd5-b71b-119a79096ce0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:48.503033 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-64468a25-6929-4dd5-b71b-119a79096ce0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:48.510744 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-64468a25-6929-4dd5-b71b-119a79096ce0 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1302 microversion: 2.1 time: 0.090829 Oct 30 00:51:48.511311 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 208/405] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:48 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1302 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:48.825938 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-6bbbc36e-2e89-4ee5-9780-581067753d6a tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:48.826548 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-6bbbc36e-2e89-4ee5-9780-581067753d6a tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:48.828384 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=2 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:48.834575 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6bbbc36e-2e89-4ee5-9780-581067753d6a tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:48.835123 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6bbbc36e-2e89-4ee5-9780-581067753d6a tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:48.835556 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6bbbc36e-2e89-4ee5-9780-581067753d6a tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:48.836303 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6bbbc36e-2e89-4ee5-9780-581067753d6a tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:48.836758 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6bbbc36e-2e89-4ee5-9780-581067753d6a tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:48.837182 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6bbbc36e-2e89-4ee5-9780-581067753d6a tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:48.903979 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-6bbbc36e-2e89-4ee5-9780-581067753d6a tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:48.912369 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-6bbbc36e-2e89-4ee5-9780-581067753d6a tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 200 len: 1222 microversion: 2.1 time: 0.090161 Oct 30 00:51:48.913191 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 198/406] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:48 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:49.535260 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-11065345-6674-4e55-8b58-4b4e97a47e8b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:49.535878 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-11065345-6674-4e55-8b58-4b4e97a47e8b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:49.541940 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-11065345-6674-4e55-8b58-4b4e97a47e8b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:49.542468 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-11065345-6674-4e55-8b58-4b4e97a47e8b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:49.542900 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-11065345-6674-4e55-8b58-4b4e97a47e8b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:49.543641 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-11065345-6674-4e55-8b58-4b4e97a47e8b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:49.544106 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-11065345-6674-4e55-8b58-4b4e97a47e8b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:49.544685 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-11065345-6674-4e55-8b58-4b4e97a47e8b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:49.697561 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-11065345-6674-4e55-8b58-4b4e97a47e8b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:49.706146 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-11065345-6674-4e55-8b58-4b4e97a47e8b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1370 microversion: 2.1 time: 0.174712 Oct 30 00:51:49.708436 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 209/407] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:49 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:49.944461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-41829410-2e56-4d3e-a07c-dc80e5aae66e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:49.945351 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-41829410-2e56-4d3e-a07c-dc80e5aae66e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:49.948886 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:49.954715 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-41829410-2e56-4d3e-a07c-dc80e5aae66e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:49.955277 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-41829410-2e56-4d3e-a07c-dc80e5aae66e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:49.955781 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-41829410-2e56-4d3e-a07c-dc80e5aae66e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:49.956583 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-41829410-2e56-4d3e-a07c-dc80e5aae66e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:49.957103 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-41829410-2e56-4d3e-a07c-dc80e5aae66e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:49.957599 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-41829410-2e56-4d3e-a07c-dc80e5aae66e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:50.028663 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-41829410-2e56-4d3e-a07c-dc80e5aae66e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:50.044622 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-41829410-2e56-4d3e-a07c-dc80e5aae66e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 200 len: 1270 microversion: 2.1 time: 0.104610 Oct 30 00:51:50.057212 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 199/408] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:49 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 1270 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:50.265901 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-5e79f3ed-6664-4693-bdc7-f2d9d6c0a07a req-19a060a9-9151-4906-8417-7ad53e6fd537 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3538515-fbfd-4f28-bc94-dd5e63e10656", "tag": "8a1c5189-8d93-4813-95d3-4fdc06d11a80"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:51:50.275629 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-5e79f3ed-6664-4693-bdc7-f2d9d6c0a07a req-19a060a9-9151-4906-8417-7ad53e6fd537 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:50.276276 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-5e79f3ed-6664-4693-bdc7-f2d9d6c0a07a req-19a060a9-9151-4906-8417-7ad53e6fd537 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:50.276966 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-5e79f3ed-6664-4693-bdc7-f2d9d6c0a07a req-19a060a9-9151-4906-8417-7ad53e6fd537 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:50.290638 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-5e79f3ed-6664-4693-bdc7-f2d9d6c0a07a req-19a060a9-9151-4906-8417-7ad53e6fd537 service nova] Creating event network-changed:8a1c5189-8d93-4813-95d3-4fdc06d11a80 for instance a3538515-fbfd-4f28-bc94-dd5e63e10656 on hv-cinder-86149 Oct 30 00:51:50.296295 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-5e79f3ed-6664-4693-bdc7-f2d9d6c0a07a req-19a060a9-9151-4906-8417-7ad53e6fd537 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034791 Oct 30 00:51:50.296980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 210/409] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:51:50.729280 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5a1e4c91-5ba3-4634-8a6d-9b2e9efc5a44 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:50.729879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5a1e4c91-5ba3-4634-8a6d-9b2e9efc5a44 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:50.737173 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a1e4c91-5ba3-4634-8a6d-9b2e9efc5a44 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:50.737907 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a1e4c91-5ba3-4634-8a6d-9b2e9efc5a44 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:50.738333 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a1e4c91-5ba3-4634-8a6d-9b2e9efc5a44 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:50.739314 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a1e4c91-5ba3-4634-8a6d-9b2e9efc5a44 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:50.739636 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a1e4c91-5ba3-4634-8a6d-9b2e9efc5a44 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:50.740052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a1e4c91-5ba3-4634-8a6d-9b2e9efc5a44 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:50.924957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5a1e4c91-5ba3-4634-8a6d-9b2e9efc5a44 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:50.933704 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5a1e4c91-5ba3-4634-8a6d-9b2e9efc5a44 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1370 microversion: 2.1 time: 0.208100 Oct 30 00:51:50.934376 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 200/410] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:50 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:51.070848 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d3b3e189-5430-440b-8d64-c5256c9ddb42 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:51.071751 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-d3b3e189-5430-440b-8d64-c5256c9ddb42 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:51.079782 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d3b3e189-5430-440b-8d64-c5256c9ddb42 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:51.080333 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d3b3e189-5430-440b-8d64-c5256c9ddb42 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:51.080764 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d3b3e189-5430-440b-8d64-c5256c9ddb42 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:51.081459 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d3b3e189-5430-440b-8d64-c5256c9ddb42 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:51.081905 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d3b3e189-5430-440b-8d64-c5256c9ddb42 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:51.082323 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d3b3e189-5430-440b-8d64-c5256c9ddb42 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:51.249423 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-d3b3e189-5430-440b-8d64-c5256c9ddb42 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:51.257189 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-d3b3e189-5430-440b-8d64-c5256c9ddb42 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 200 len: 1318 microversion: 2.1 time: 0.191076 Oct 30 00:51:51.257782 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 211/411] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:51 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:51:51.958505 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5a82fd40-8c13-439c-a892-712adcefe470 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:51.959107 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5a82fd40-8c13-439c-a892-712adcefe470 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:51.965428 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a82fd40-8c13-439c-a892-712adcefe470 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:51.965937 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a82fd40-8c13-439c-a892-712adcefe470 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:51.966371 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a82fd40-8c13-439c-a892-712adcefe470 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:51.967059 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a82fd40-8c13-439c-a892-712adcefe470 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:51.967517 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a82fd40-8c13-439c-a892-712adcefe470 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:51.967936 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a82fd40-8c13-439c-a892-712adcefe470 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:52.098759 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5a82fd40-8c13-439c-a892-712adcefe470 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:52.106236 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5a82fd40-8c13-439c-a892-712adcefe470 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1370 microversion: 2.1 time: 0.151647 Oct 30 00:51:52.106781 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 201/412] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:51 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:52.281052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-92f121c9-7b89-40a8-8505-ab4d8a0333cb tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:52.281667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-92f121c9-7b89-40a8-8505-ab4d8a0333cb tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:52.287836 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-92f121c9-7b89-40a8-8505-ab4d8a0333cb tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:52.288270 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-92f121c9-7b89-40a8-8505-ab4d8a0333cb tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:52.288701 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-92f121c9-7b89-40a8-8505-ab4d8a0333cb tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:52.289389 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-92f121c9-7b89-40a8-8505-ab4d8a0333cb tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:52.289834 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-92f121c9-7b89-40a8-8505-ab4d8a0333cb tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:52.290250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-92f121c9-7b89-40a8-8505-ab4d8a0333cb tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:52.421690 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-92f121c9-7b89-40a8-8505-ab4d8a0333cb tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:52.430064 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-92f121c9-7b89-40a8-8505-ab4d8a0333cb tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 200 len: 1318 microversion: 2.1 time: 0.153311 Oct 30 00:51:52.430728 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 212/413] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:52 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:53.129204 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-2d9a13cc-6f56-4338-9f86-58ada412e8f7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:53.129718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-2d9a13cc-6f56-4338-9f86-58ada412e8f7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:53.135998 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2d9a13cc-6f56-4338-9f86-58ada412e8f7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:53.136511 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2d9a13cc-6f56-4338-9f86-58ada412e8f7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:53.136938 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2d9a13cc-6f56-4338-9f86-58ada412e8f7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:53.137618 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2d9a13cc-6f56-4338-9f86-58ada412e8f7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:53.138065 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2d9a13cc-6f56-4338-9f86-58ada412e8f7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:53.138482 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2d9a13cc-6f56-4338-9f86-58ada412e8f7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:53.271006 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-2d9a13cc-6f56-4338-9f86-58ada412e8f7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:53.278479 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-2d9a13cc-6f56-4338-9f86-58ada412e8f7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1370 microversion: 2.1 time: 0.153157 Oct 30 00:51:53.279118 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 202/414] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:53 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:53.455849 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-53c4fb12-31e6-46f0-a3af-142ed3ad0f84 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:53.456483 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-53c4fb12-31e6-46f0-a3af-142ed3ad0f84 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:53.462315 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-53c4fb12-31e6-46f0-a3af-142ed3ad0f84 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:53.462787 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-53c4fb12-31e6-46f0-a3af-142ed3ad0f84 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:53.463208 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-53c4fb12-31e6-46f0-a3af-142ed3ad0f84 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:53.463883 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-53c4fb12-31e6-46f0-a3af-142ed3ad0f84 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:53.464361 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-53c4fb12-31e6-46f0-a3af-142ed3ad0f84 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:53.464773 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-53c4fb12-31e6-46f0-a3af-142ed3ad0f84 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:53.594386 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-53c4fb12-31e6-46f0-a3af-142ed3ad0f84 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:53.602722 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-53c4fb12-31e6-46f0-a3af-142ed3ad0f84 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 200 len: 1318 microversion: 2.1 time: 0.151778 Oct 30 00:51:53.603295 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 213/415] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:53 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:54.303083 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-9803edcf-135c-4469-a553-44c1e8988d92 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:54.303795 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-9803edcf-135c-4469-a553-44c1e8988d92 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:54.310266 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9803edcf-135c-4469-a553-44c1e8988d92 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:54.310826 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9803edcf-135c-4469-a553-44c1e8988d92 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:54.311461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9803edcf-135c-4469-a553-44c1e8988d92 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:54.312182 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9803edcf-135c-4469-a553-44c1e8988d92 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:54.312712 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9803edcf-135c-4469-a553-44c1e8988d92 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:54.313145 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9803edcf-135c-4469-a553-44c1e8988d92 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:54.449419 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-9803edcf-135c-4469-a553-44c1e8988d92 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:54.458626 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-9803edcf-135c-4469-a553-44c1e8988d92 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1370 microversion: 2.1 time: 0.159358 Oct 30 00:51:54.472993 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 203/416] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:54 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:54.494284 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-7d05930c-4959-4eee-a0ed-244e8fbb0808 req-8391317b-c1af-44a0-92ba-421cb24e8b67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be9e8cf5-e50a-4fab-b8ce-c388caa2223f", "tag": "7ffb5d5a-9588-4010-90d3-14acde968f35"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:51:54.508529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-7d05930c-4959-4eee-a0ed-244e8fbb0808 req-8391317b-c1af-44a0-92ba-421cb24e8b67 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:54.509002 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-7d05930c-4959-4eee-a0ed-244e8fbb0808 req-8391317b-c1af-44a0-92ba-421cb24e8b67 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:54.509439 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-7d05930c-4959-4eee-a0ed-244e8fbb0808 req-8391317b-c1af-44a0-92ba-421cb24e8b67 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:54.521576 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-7d05930c-4959-4eee-a0ed-244e8fbb0808 req-8391317b-c1af-44a0-92ba-421cb24e8b67 service nova] Creating event network-changed:7ffb5d5a-9588-4010-90d3-14acde968f35 for instance be9e8cf5-e50a-4fab-b8ce-c388caa2223f on hv-cinder-86149 Oct 30 00:51:54.527877 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-7d05930c-4959-4eee-a0ed-244e8fbb0808 req-8391317b-c1af-44a0-92ba-421cb24e8b67 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037352 Oct 30 00:51:54.528500 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 214/417] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:51:54.626771 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-02c72ede-804c-4004-ab15-40a0de63fb78 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:54.627475 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-02c72ede-804c-4004-ab15-40a0de63fb78 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:54.637764 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-02c72ede-804c-4004-ab15-40a0de63fb78 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:54.641117 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-02c72ede-804c-4004-ab15-40a0de63fb78 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:54.642393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-02c72ede-804c-4004-ab15-40a0de63fb78 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:54.644576 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-02c72ede-804c-4004-ab15-40a0de63fb78 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:54.645397 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-02c72ede-804c-4004-ab15-40a0de63fb78 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:54.646159 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-02c72ede-804c-4004-ab15-40a0de63fb78 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:54.805953 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-02c72ede-804c-4004-ab15-40a0de63fb78 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:54.813722 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-02c72ede-804c-4004-ab15-40a0de63fb78 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 200 len: 1318 microversion: 2.1 time: 0.192287 Oct 30 00:51:54.814278 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 204/418] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:54 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:55.484607 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-6c8e3a68-3332-4012-a826-80b44866948c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:55.485293 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-6c8e3a68-3332-4012-a826-80b44866948c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:55.491346 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6c8e3a68-3332-4012-a826-80b44866948c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:55.491818 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6c8e3a68-3332-4012-a826-80b44866948c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:55.492265 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6c8e3a68-3332-4012-a826-80b44866948c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:55.492938 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6c8e3a68-3332-4012-a826-80b44866948c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:55.493381 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6c8e3a68-3332-4012-a826-80b44866948c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:55.493797 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6c8e3a68-3332-4012-a826-80b44866948c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:55.538231 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=2 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:55.556954 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=14 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:55.625767 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6c8e3a68-3332-4012-a826-80b44866948c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:55.633265 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-6c8e3a68-3332-4012-a826-80b44866948c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1370 microversion: 2.1 time: 0.152885 Oct 30 00:51:55.633814 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 215/419] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:55 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:55.836533 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-4f0c6664-d8c7-445f-abb8-d2a5514708b8 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:55.837250 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-4f0c6664-d8c7-445f-abb8-d2a5514708b8 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:55.843591 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4f0c6664-d8c7-445f-abb8-d2a5514708b8 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:55.844064 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4f0c6664-d8c7-445f-abb8-d2a5514708b8 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:55.844527 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4f0c6664-d8c7-445f-abb8-d2a5514708b8 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:55.845201 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4f0c6664-d8c7-445f-abb8-d2a5514708b8 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:55.845647 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4f0c6664-d8c7-445f-abb8-d2a5514708b8 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:55.846370 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4f0c6664-d8c7-445f-abb8-d2a5514708b8 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:55.975666 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-4f0c6664-d8c7-445f-abb8-d2a5514708b8 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:55.984892 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-4f0c6664-d8c7-445f-abb8-d2a5514708b8 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 200 len: 1318 microversion: 2.1 time: 0.152109 Oct 30 00:51:55.985449 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 205/420] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:55 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:56.656911 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d4e16292-ce98-4185-b649-1501c786c5f4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:56.657513 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-d4e16292-ce98-4185-b649-1501c786c5f4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:56.663300 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d4e16292-ce98-4185-b649-1501c786c5f4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:56.663777 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d4e16292-ce98-4185-b649-1501c786c5f4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:56.664241 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d4e16292-ce98-4185-b649-1501c786c5f4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:56.664925 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d4e16292-ce98-4185-b649-1501c786c5f4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:56.665373 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d4e16292-ce98-4185-b649-1501c786c5f4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:56.665804 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d4e16292-ce98-4185-b649-1501c786c5f4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:56.792965 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-d4e16292-ce98-4185-b649-1501c786c5f4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:56.800686 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-d4e16292-ce98-4185-b649-1501c786c5f4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1370 microversion: 2.1 time: 0.148023 Oct 30 00:51:56.801248 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 216/421] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:56 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:57.008575 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-438838a1-746e-4d17-82bb-ec75495787e1 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:57.009166 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-438838a1-746e-4d17-82bb-ec75495787e1 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:57.011004 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=12 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:57.017867 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-438838a1-746e-4d17-82bb-ec75495787e1 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:57.018386 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-438838a1-746e-4d17-82bb-ec75495787e1 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:57.018869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-438838a1-746e-4d17-82bb-ec75495787e1 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:57.019645 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-438838a1-746e-4d17-82bb-ec75495787e1 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:57.020178 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-438838a1-746e-4d17-82bb-ec75495787e1 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:57.020869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-438838a1-746e-4d17-82bb-ec75495787e1 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:57.025150 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=82 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:51:57.151670 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-438838a1-746e-4d17-82bb-ec75495787e1 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:57.159360 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-438838a1-746e-4d17-82bb-ec75495787e1 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 200 len: 1318 microversion: 2.1 time: 0.154744 Oct 30 00:51:57.159909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 206/422] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:57 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:57.822921 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-098d93fe-d1f1-469a-ae2f-d949f8335532 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:57.823526 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-098d93fe-d1f1-469a-ae2f-d949f8335532 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:57.829786 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-098d93fe-d1f1-469a-ae2f-d949f8335532 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:57.830254 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-098d93fe-d1f1-469a-ae2f-d949f8335532 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:57.830681 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-098d93fe-d1f1-469a-ae2f-d949f8335532 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:57.831361 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-098d93fe-d1f1-469a-ae2f-d949f8335532 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:57.831806 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-098d93fe-d1f1-469a-ae2f-d949f8335532 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:57.832263 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-098d93fe-d1f1-469a-ae2f-d949f8335532 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:57.960656 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-098d93fe-d1f1-469a-ae2f-d949f8335532 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:57.969204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-098d93fe-d1f1-469a-ae2f-d949f8335532 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1370 microversion: 2.1 time: 0.150101 Oct 30 00:51:57.969770 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 217/423] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:57 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:58.182295 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3f3fa5e8-6d11-4eff-b719-ce6dc92deae3 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:58.182925 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-3f3fa5e8-6d11-4eff-b719-ce6dc92deae3 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:58.189849 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3f3fa5e8-6d11-4eff-b719-ce6dc92deae3 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:58.190327 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3f3fa5e8-6d11-4eff-b719-ce6dc92deae3 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:58.190754 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3f3fa5e8-6d11-4eff-b719-ce6dc92deae3 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:58.191448 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3f3fa5e8-6d11-4eff-b719-ce6dc92deae3 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:58.191894 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3f3fa5e8-6d11-4eff-b719-ce6dc92deae3 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:58.192584 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3f3fa5e8-6d11-4eff-b719-ce6dc92deae3 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:58.349191 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3f3fa5e8-6d11-4eff-b719-ce6dc92deae3 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:58.359283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-3f3fa5e8-6d11-4eff-b719-ce6dc92deae3 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 200 len: 1318 microversion: 2.1 time: 0.180093 Oct 30 00:51:58.359872 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 207/424] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:58 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:58.997271 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-49099909-c6de-4c3e-9562-9e36b5ead3d3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:58.997902 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-49099909-c6de-4c3e-9562-9e36b5ead3d3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:59.004670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-49099909-c6de-4c3e-9562-9e36b5ead3d3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:59.005150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-49099909-c6de-4c3e-9562-9e36b5ead3d3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:59.005581 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-49099909-c6de-4c3e-9562-9e36b5ead3d3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:59.006270 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-49099909-c6de-4c3e-9562-9e36b5ead3d3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:59.006732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-49099909-c6de-4c3e-9562-9e36b5ead3d3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:59.007133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-49099909-c6de-4c3e-9562-9e36b5ead3d3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:59.145853 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-49099909-c6de-4c3e-9562-9e36b5ead3d3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:59.153509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-49099909-c6de-4c3e-9562-9e36b5ead3d3 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1370 microversion: 2.1 time: 0.160110 Oct 30 00:51:59.154080 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 218/425] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:58 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:51:59.382890 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-8a5812e2-e346-482e-9aab-6b2302e10ab5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:51:59.383482 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-8a5812e2-e346-482e-9aab-6b2302e10ab5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:51:59.390368 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a5812e2-e346-482e-9aab-6b2302e10ab5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:59.390785 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a5812e2-e346-482e-9aab-6b2302e10ab5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:59.391214 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a5812e2-e346-482e-9aab-6b2302e10ab5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:59.391899 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a5812e2-e346-482e-9aab-6b2302e10ab5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:51:59.392377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a5812e2-e346-482e-9aab-6b2302e10ab5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:51:59.392799 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a5812e2-e346-482e-9aab-6b2302e10ab5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:51:59.520291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8a5812e2-e346-482e-9aab-6b2302e10ab5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:51:59.527873 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-8a5812e2-e346-482e-9aab-6b2302e10ab5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 200 len: 1318 microversion: 2.1 time: 0.148900 Oct 30 00:51:59.528450 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 208/426] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:51:59 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:00.177846 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4e580f55-1f1b-4c77-8e70-b945711ff72e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:00.178440 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-4e580f55-1f1b-4c77-8e70-b945711ff72e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:00.184413 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e580f55-1f1b-4c77-8e70-b945711ff72e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:00.184891 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e580f55-1f1b-4c77-8e70-b945711ff72e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:00.185330 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e580f55-1f1b-4c77-8e70-b945711ff72e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:00.186013 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e580f55-1f1b-4c77-8e70-b945711ff72e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:00.187070 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e580f55-1f1b-4c77-8e70-b945711ff72e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:00.187496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e580f55-1f1b-4c77-8e70-b945711ff72e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:00.329594 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4e580f55-1f1b-4c77-8e70-b945711ff72e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:00.337764 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-4e580f55-1f1b-4c77-8e70-b945711ff72e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1370 microversion: 2.1 time: 0.163543 Oct 30 00:52:00.338387 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 219/427] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:00 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:00.389852 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-03113c8c-2f8f-42a5-9614-0e3a4e40c8bc req-949f5362-60d2-4707-b607-ae2d5844a330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3538515-fbfd-4f28-bc94-dd5e63e10656", "name": "network-vif-plugged", "status": "completed", "tag": "8a1c5189-8d93-4813-95d3-4fdc06d11a80"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:52:00.401487 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-03113c8c-2f8f-42a5-9614-0e3a4e40c8bc req-949f5362-60d2-4707-b607-ae2d5844a330 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:00.402042 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-03113c8c-2f8f-42a5-9614-0e3a4e40c8bc req-949f5362-60d2-4707-b607-ae2d5844a330 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:00.402766 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-03113c8c-2f8f-42a5-9614-0e3a4e40c8bc req-949f5362-60d2-4707-b607-ae2d5844a330 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:00.415111 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-03113c8c-2f8f-42a5-9614-0e3a4e40c8bc req-949f5362-60d2-4707-b607-ae2d5844a330 service nova] Creating event network-vif-plugged:8a1c5189-8d93-4813-95d3-4fdc06d11a80 for instance a3538515-fbfd-4f28-bc94-dd5e63e10656 on hv-cinder-86149 Oct 30 00:52:00.420519 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-03113c8c-2f8f-42a5-9614-0e3a4e40c8bc req-949f5362-60d2-4707-b607-ae2d5844a330 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034606 Oct 30 00:52:00.422028 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 209/428] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:52:00.550597 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ac15f0f1-e824-4a78-85f1-3a483c5c1fb5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:00.551209 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ac15f0f1-e824-4a78-85f1-3a483c5c1fb5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:00.557261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ac15f0f1-e824-4a78-85f1-3a483c5c1fb5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:00.557741 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ac15f0f1-e824-4a78-85f1-3a483c5c1fb5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:00.558170 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ac15f0f1-e824-4a78-85f1-3a483c5c1fb5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:00.558855 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ac15f0f1-e824-4a78-85f1-3a483c5c1fb5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:00.559301 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ac15f0f1-e824-4a78-85f1-3a483c5c1fb5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:00.559750 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ac15f0f1-e824-4a78-85f1-3a483c5c1fb5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:00.689926 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ac15f0f1-e824-4a78-85f1-3a483c5c1fb5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:00.697631 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ac15f0f1-e824-4a78-85f1-3a483c5c1fb5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 200 len: 1318 microversion: 2.1 time: 0.150864 Oct 30 00:52:00.698185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 220/429] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:00 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:01.364034 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-76e9e4e7-6730-4614-ba70-ec9d7f2bcac5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:01.364748 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-76e9e4e7-6730-4614-ba70-ec9d7f2bcac5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:01.370858 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-76e9e4e7-6730-4614-ba70-ec9d7f2bcac5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:01.371362 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-76e9e4e7-6730-4614-ba70-ec9d7f2bcac5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:01.371793 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-76e9e4e7-6730-4614-ba70-ec9d7f2bcac5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:01.372502 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-76e9e4e7-6730-4614-ba70-ec9d7f2bcac5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:01.372953 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-76e9e4e7-6730-4614-ba70-ec9d7f2bcac5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:01.373372 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-76e9e4e7-6730-4614-ba70-ec9d7f2bcac5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:01.502555 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-76e9e4e7-6730-4614-ba70-ec9d7f2bcac5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:01.511056 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-76e9e4e7-6730-4614-ba70-ec9d7f2bcac5 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1370 microversion: 2.1 time: 0.151179 Oct 30 00:52:01.516121 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 210/430] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:01 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:01.721477 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-1ad4571b-30a6-4098-a0ae-5fa339e78d5b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:01.722084 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-1ad4571b-30a6-4098-a0ae-5fa339e78d5b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:01.731078 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1ad4571b-30a6-4098-a0ae-5fa339e78d5b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:01.731534 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1ad4571b-30a6-4098-a0ae-5fa339e78d5b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:01.731965 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1ad4571b-30a6-4098-a0ae-5fa339e78d5b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:01.732687 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1ad4571b-30a6-4098-a0ae-5fa339e78d5b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:01.733218 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1ad4571b-30a6-4098-a0ae-5fa339e78d5b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:01.734158 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1ad4571b-30a6-4098-a0ae-5fa339e78d5b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:01.929231 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-1ad4571b-30a6-4098-a0ae-5fa339e78d5b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:01.937826 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-1ad4571b-30a6-4098-a0ae-5fa339e78d5b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 200 len: 1318 microversion: 2.1 time: 0.220862 Oct 30 00:52:01.938471 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 221/431] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:01 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:02.534498 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d73146c1-bcb8-4de0-b0cb-f95e5b8f0b8c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:02.535104 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d73146c1-bcb8-4de0-b0cb-f95e5b8f0b8c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:02.541437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d73146c1-bcb8-4de0-b0cb-f95e5b8f0b8c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:02.541916 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d73146c1-bcb8-4de0-b0cb-f95e5b8f0b8c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:02.542342 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d73146c1-bcb8-4de0-b0cb-f95e5b8f0b8c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:02.543034 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d73146c1-bcb8-4de0-b0cb-f95e5b8f0b8c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:02.543481 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d73146c1-bcb8-4de0-b0cb-f95e5b8f0b8c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:02.543902 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d73146c1-bcb8-4de0-b0cb-f95e5b8f0b8c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:02.677947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d73146c1-bcb8-4de0-b0cb-f95e5b8f0b8c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:02.685557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d73146c1-bcb8-4de0-b0cb-f95e5b8f0b8c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1370 microversion: 2.1 time: 0.155060 Oct 30 00:52:02.686137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 211/432] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:02 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:02.964770 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-87c71e4a-aee5-4e6f-add7-7b2f8f0eaf65 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:02.965475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-87c71e4a-aee5-4e6f-add7-7b2f8f0eaf65 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:02.973616 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-87c71e4a-aee5-4e6f-add7-7b2f8f0eaf65 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:02.974236 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-87c71e4a-aee5-4e6f-add7-7b2f8f0eaf65 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:02.977590 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-87c71e4a-aee5-4e6f-add7-7b2f8f0eaf65 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:02.977590 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-87c71e4a-aee5-4e6f-add7-7b2f8f0eaf65 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:02.977590 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-87c71e4a-aee5-4e6f-add7-7b2f8f0eaf65 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:02.977590 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-87c71e4a-aee5-4e6f-add7-7b2f8f0eaf65 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:03.114895 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-87c71e4a-aee5-4e6f-add7-7b2f8f0eaf65 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:03.124745 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-87c71e4a-aee5-4e6f-add7-7b2f8f0eaf65 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 200 len: 1318 microversion: 2.1 time: 0.163842 Oct 30 00:52:03.125439 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 222/433] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:02 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:03.709369 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-00b9e865-80ba-4ea8-8044-7fd9c2e23462 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:03.710672 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-00b9e865-80ba-4ea8-8044-7fd9c2e23462 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:03.718518 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-00b9e865-80ba-4ea8-8044-7fd9c2e23462 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:03.718730 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-00b9e865-80ba-4ea8-8044-7fd9c2e23462 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:03.719364 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-00b9e865-80ba-4ea8-8044-7fd9c2e23462 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:03.720465 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-00b9e865-80ba-4ea8-8044-7fd9c2e23462 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:03.720918 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-00b9e865-80ba-4ea8-8044-7fd9c2e23462 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:03.721522 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-00b9e865-80ba-4ea8-8044-7fd9c2e23462 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:03.863757 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-00b9e865-80ba-4ea8-8044-7fd9c2e23462 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:03.873451 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-00b9e865-80ba-4ea8-8044-7fd9c2e23462 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1370 microversion: 2.1 time: 0.167845 Oct 30 00:52:03.874510 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 212/434] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:03 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:04.148206 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-3d2027be-c2ef-4626-a34b-9a2c9883c069 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:04.148814 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-3d2027be-c2ef-4626-a34b-9a2c9883c069 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:04.154885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3d2027be-c2ef-4626-a34b-9a2c9883c069 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:04.156021 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3d2027be-c2ef-4626-a34b-9a2c9883c069 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:04.156480 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3d2027be-c2ef-4626-a34b-9a2c9883c069 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:04.157287 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3d2027be-c2ef-4626-a34b-9a2c9883c069 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:04.157745 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3d2027be-c2ef-4626-a34b-9a2c9883c069 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:04.158159 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3d2027be-c2ef-4626-a34b-9a2c9883c069 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:04.179579 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=100 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:04.311343 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-3d2027be-c2ef-4626-a34b-9a2c9883c069 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:04.320881 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-3d2027be-c2ef-4626-a34b-9a2c9883c069 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 200 len: 1318 microversion: 2.1 time: 0.176321 Oct 30 00:52:04.328123 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 223/435] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:04 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:04.417780 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-dc82407c-4345-4dc3-8d1e-f36286fedbbe req-5221ca7c-29b4-4bc2-8c5b-c5be2a8c76bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be9e8cf5-e50a-4fab-b8ce-c388caa2223f", "name": "network-vif-plugged", "status": "completed", "tag": "7ffb5d5a-9588-4010-90d3-14acde968f35"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:52:04.428421 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-dc82407c-4345-4dc3-8d1e-f36286fedbbe req-5221ca7c-29b4-4bc2-8c5b-c5be2a8c76bc service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:04.429265 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-dc82407c-4345-4dc3-8d1e-f36286fedbbe req-5221ca7c-29b4-4bc2-8c5b-c5be2a8c76bc service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:04.429940 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-dc82407c-4345-4dc3-8d1e-f36286fedbbe req-5221ca7c-29b4-4bc2-8c5b-c5be2a8c76bc service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:04.443454 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-dc82407c-4345-4dc3-8d1e-f36286fedbbe req-5221ca7c-29b4-4bc2-8c5b-c5be2a8c76bc service nova] Creating event network-vif-plugged:7ffb5d5a-9588-4010-90d3-14acde968f35 for instance be9e8cf5-e50a-4fab-b8ce-c388caa2223f on hv-cinder-86149 Oct 30 00:52:04.449136 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-dc82407c-4345-4dc3-8d1e-f36286fedbbe req-5221ca7c-29b4-4bc2-8c5b-c5be2a8c76bc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035250 Oct 30 00:52:04.450761 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 213/436] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:52:04.897044 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-e5b3f9fb-cbcd-4854-80a6-66d4450c36c1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:04.897956 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-e5b3f9fb-cbcd-4854-80a6-66d4450c36c1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:04.908390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e5b3f9fb-cbcd-4854-80a6-66d4450c36c1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:04.909292 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e5b3f9fb-cbcd-4854-80a6-66d4450c36c1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:04.909961 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e5b3f9fb-cbcd-4854-80a6-66d4450c36c1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:04.910911 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e5b3f9fb-cbcd-4854-80a6-66d4450c36c1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:04.911560 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e5b3f9fb-cbcd-4854-80a6-66d4450c36c1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:04.912243 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e5b3f9fb-cbcd-4854-80a6-66d4450c36c1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:05.065544 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e5b3f9fb-cbcd-4854-80a6-66d4450c36c1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:05.074718 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-e5b3f9fb-cbcd-4854-80a6-66d4450c36c1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1564 microversion: 2.1 time: 0.181339 Oct 30 00:52:05.075302 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 224/437] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:04 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1564 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:05.099304 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-15fdfb2e-f470-4ca9-b3af-0c23f039c165 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:05.100583 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-15fdfb2e-f470-4ca9-b3af-0c23f039c165 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:05.107458 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-15fdfb2e-f470-4ca9-b3af-0c23f039c165 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:05.108691 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-15fdfb2e-f470-4ca9-b3af-0c23f039c165 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:05.110256 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-15fdfb2e-f470-4ca9-b3af-0c23f039c165 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:05.110967 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-15fdfb2e-f470-4ca9-b3af-0c23f039c165 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:05.111419 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-15fdfb2e-f470-4ca9-b3af-0c23f039c165 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:05.111837 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-15fdfb2e-f470-4ca9-b3af-0c23f039c165 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:05.206576 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-15fdfb2e-f470-4ca9-b3af-0c23f039c165 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111633 Oct 30 00:52:05.207384 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 214/438] 10.222.0.36 () {58 vars in 1275 bytes} [Sun Oct 30 00:52:05 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:52:05.348590 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-80d8736c-3ecb-44b1-bc4f-a38cf42966fb tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:05.350523 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-80d8736c-3ecb-44b1-bc4f-a38cf42966fb tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:05.358031 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-80d8736c-3ecb-44b1-bc4f-a38cf42966fb tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:05.358711 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-80d8736c-3ecb-44b1-bc4f-a38cf42966fb tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:05.360192 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-80d8736c-3ecb-44b1-bc4f-a38cf42966fb tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:05.361311 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-80d8736c-3ecb-44b1-bc4f-a38cf42966fb tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:05.362688 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-80d8736c-3ecb-44b1-bc4f-a38cf42966fb tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:05.363401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-80d8736c-3ecb-44b1-bc4f-a38cf42966fb tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:05.847639 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-80d8736c-3ecb-44b1-bc4f-a38cf42966fb tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:05.855414 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-80d8736c-3ecb-44b1-bc4f-a38cf42966fb tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 200 len: 1318 microversion: 2.1 time: 0.513751 Oct 30 00:52:05.855980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 225/439] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:05 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 1318 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:06.443596 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-3ee69c78-ab5b-4741-97be-50403ee49303 req-39aed402-7a70-4594-af94-b30743c28fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3538515-fbfd-4f28-bc94-dd5e63e10656", "tag": "8a1c5189-8d93-4813-95d3-4fdc06d11a80"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:52:06.453452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-3ee69c78-ab5b-4741-97be-50403ee49303 req-39aed402-7a70-4594-af94-b30743c28fe2 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:06.453918 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-3ee69c78-ab5b-4741-97be-50403ee49303 req-39aed402-7a70-4594-af94-b30743c28fe2 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:06.454349 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-3ee69c78-ab5b-4741-97be-50403ee49303 req-39aed402-7a70-4594-af94-b30743c28fe2 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:06.465470 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-3ee69c78-ab5b-4741-97be-50403ee49303 req-39aed402-7a70-4594-af94-b30743c28fe2 service nova] Creating event network-changed:8a1c5189-8d93-4813-95d3-4fdc06d11a80 for instance a3538515-fbfd-4f28-bc94-dd5e63e10656 on hv-cinder-86149 Oct 30 00:52:06.471237 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-3ee69c78-ab5b-4741-97be-50403ee49303 req-39aed402-7a70-4594-af94-b30743c28fe2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032112 Oct 30 00:52:06.472017 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 215/440] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:52:06.565244 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-cc7e1e89-a1bf-476c-8c42-bd7191a60fed tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1532138195", "imageRef": "27983dee-4bd6-4aad-9c28-22bd5382709a", "flavorRef": "452", "networks": [{"uuid": "55bb4c66-29fe-45a7-9f60-8b370dd9914f"}]}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:52:06.624353 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.network.neutron [None req-cc7e1e89-a1bf-476c-8c42-bd7191a60fed tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] validate_networks() for [('55bb4c66-29fe-45a7-9f60-8b370dd9914f', None, None, None, None, None)] {{(pid=125554) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 00:52:06.879480 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-029ae624-300b-4f70-bd07-2b4113c2647f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:06.880212 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-029ae624-300b-4f70-bd07-2b4113c2647f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:06.911064 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-029ae624-300b-4f70-bd07-2b4113c2647f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:06.913441 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-029ae624-300b-4f70-bd07-2b4113c2647f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:06.916806 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-029ae624-300b-4f70-bd07-2b4113c2647f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:06.918392 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-029ae624-300b-4f70-bd07-2b4113c2647f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:06.919673 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-029ae624-300b-4f70-bd07-2b4113c2647f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:06.921784 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-029ae624-300b-4f70-bd07-2b4113c2647f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:07.050283 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-cc7e1e89-a1bf-476c-8c42-bd7191a60fed tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Flavor limits 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 00:52:07.050606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-cc7e1e89-a1bf-476c-8c42-bd7191a60fed tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Image limits 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 00:52:07.050976 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-cc7e1e89-a1bf-476c-8c42-bd7191a60fed tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Flavor pref 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 00:52:07.052118 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-cc7e1e89-a1bf-476c-8c42-bd7191a60fed tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Image pref 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 00:52:07.052118 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-cc7e1e89-a1bf-476c-8c42-bd7191a60fed tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 00:52:07.060740 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cc7e1e89-a1bf-476c-8c42-bd7191a60fed tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:07.061141 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cc7e1e89-a1bf-476c-8c42-bd7191a60fed tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:07.061801 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cc7e1e89-a1bf-476c-8c42-bd7191a60fed tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:07.062713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cc7e1e89-a1bf-476c-8c42-bd7191a60fed tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:07.063310 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cc7e1e89-a1bf-476c-8c42-bd7191a60fed tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:07.063885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cc7e1e89-a1bf-476c-8c42-bd7191a60fed tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:07.082627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-cc7e1e89-a1bf-476c-8c42-bd7191a60fed tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Getting quotas for project d870a579f94748d1998b1902b9dc8636. Resources: {'instances', 'cores', 'ram'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 00:52:07.087099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-cc7e1e89-a1bf-476c-8c42-bd7191a60fed tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Getting quotas for user b8b8683a89f043b792dc6ba73af2d22b and project d870a579f94748d1998b1902b9dc8636. Resources: {'instances', 'cores', 'ram'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 00:52:07.100984 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-cc7e1e89-a1bf-476c-8c42-bd7191a60fed tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Going to run 1 instances... {{(pid=125554) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 00:52:07.102686 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-029ae624-300b-4f70-bd07-2b4113c2647f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:07.103281 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-cc7e1e89-a1bf-476c-8c42-bd7191a60fed tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 070baf10-b612-4a7f-8697-18cd36dcf5c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27983dee-4bd6-4aad-9c28-22bd5382709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125554) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 00:52:07.111036 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-029ae624-300b-4f70-bd07-2b4113c2647f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 200 len: 1506 microversion: 2.1 time: 0.235862 Oct 30 00:52:07.124608 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 216/441] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:06 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:52:07.169941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-cc7e1e89-a1bf-476c-8c42-bd7191a60fed tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609226 Oct 30 00:52:07.170587 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 226/442] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Oct 30 00:52:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 00:52:07.181994 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-7102fa00-3931-46bc-9d4a-ce0a026751b5 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:07.183241 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-7102fa00-3931-46bc-9d4a-ce0a026751b5 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 070baf10-b612-4a7f-8697-18cd36dcf5c6] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:07.276108 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-7102fa00-3931-46bc-9d4a-ce0a026751b5 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:07.284574 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-7102fa00-3931-46bc-9d4a-ce0a026751b5 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6" status: 200 len: 1214 microversion: 2.1 time: 0.106265 Oct 30 00:52:07.286175 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 217/443] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:07 2022] GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:08.307166 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-894343bc-7492-4653-92fb-a63ac4ff0fe8 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:08.307768 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-894343bc-7492-4653-92fb-a63ac4ff0fe8 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 070baf10-b612-4a7f-8697-18cd36dcf5c6] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:08.314440 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-894343bc-7492-4653-92fb-a63ac4ff0fe8 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:08.314913 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-894343bc-7492-4653-92fb-a63ac4ff0fe8 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:08.315338 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-894343bc-7492-4653-92fb-a63ac4ff0fe8 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:08.316018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-894343bc-7492-4653-92fb-a63ac4ff0fe8 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:08.316487 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-894343bc-7492-4653-92fb-a63ac4ff0fe8 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:08.316900 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-894343bc-7492-4653-92fb-a63ac4ff0fe8 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:08.386083 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-894343bc-7492-4653-92fb-a63ac4ff0fe8 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:08.393691 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-894343bc-7492-4653-92fb-a63ac4ff0fe8 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6" status: 200 len: 1266 microversion: 2.1 time: 0.090772 Oct 30 00:52:08.394235 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 227/444] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:08 2022] GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:52:09.102755 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-194a415b-83d8-4464-9dba-45270d086c72 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:09.103322 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-194a415b-83d8-4464-9dba-45270d086c72 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:09.109719 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-194a415b-83d8-4464-9dba-45270d086c72 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:09.110205 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-194a415b-83d8-4464-9dba-45270d086c72 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:09.110661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-194a415b-83d8-4464-9dba-45270d086c72 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:09.111365 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-194a415b-83d8-4464-9dba-45270d086c72 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:09.111815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-194a415b-83d8-4464-9dba-45270d086c72 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:09.112271 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-194a415b-83d8-4464-9dba-45270d086c72 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:09.137223 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-194a415b-83d8-4464-9dba-45270d086c72 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833/ips" status: 200 len: 151 microversion: 2.20 time: 0.038187 Oct 30 00:52:09.137806 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 218/445] 10.222.0.36 () {60 vars in 1289 bytes} [Sun Oct 30 00:52:09 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:52:09.417860 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-50ef611e-10c6-4b0d-b1ff-b32bb82e5be9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:09.418831 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-50ef611e-10c6-4b0d-b1ff-b32bb82e5be9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 070baf10-b612-4a7f-8697-18cd36dcf5c6] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:09.429509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50ef611e-10c6-4b0d-b1ff-b32bb82e5be9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:09.429997 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50ef611e-10c6-4b0d-b1ff-b32bb82e5be9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:09.430423 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50ef611e-10c6-4b0d-b1ff-b32bb82e5be9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:09.435288 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50ef611e-10c6-4b0d-b1ff-b32bb82e5be9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:09.435399 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50ef611e-10c6-4b0d-b1ff-b32bb82e5be9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:09.435825 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50ef611e-10c6-4b0d-b1ff-b32bb82e5be9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:09.602832 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-50ef611e-10c6-4b0d-b1ff-b32bb82e5be9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:09.611035 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-50ef611e-10c6-4b0d-b1ff-b32bb82e5be9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6" status: 200 len: 1314 microversion: 2.1 time: 0.197844 Oct 30 00:52:09.611609 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 228/446] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:09 2022] GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:10.236265 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-99ab7617-8041-4023-9922-15be97410396 req-e0f03de5-b080-423f-be51-30089a85cecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "070baf10-b612-4a7f-8697-18cd36dcf5c6", "tag": "f7e7fc0b-4154-4003-82d6-1fd31a77c5f0"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:52:10.250572 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-99ab7617-8041-4023-9922-15be97410396 req-e0f03de5-b080-423f-be51-30089a85cecb service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:10.251050 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-99ab7617-8041-4023-9922-15be97410396 req-e0f03de5-b080-423f-be51-30089a85cecb service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:10.251498 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-99ab7617-8041-4023-9922-15be97410396 req-e0f03de5-b080-423f-be51-30089a85cecb service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:10.262239 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-99ab7617-8041-4023-9922-15be97410396 req-e0f03de5-b080-423f-be51-30089a85cecb service nova] Creating event network-changed:f7e7fc0b-4154-4003-82d6-1fd31a77c5f0 for instance 070baf10-b612-4a7f-8697-18cd36dcf5c6 on hv-cinder-86149 Oct 30 00:52:10.267905 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-99ab7617-8041-4023-9922-15be97410396 req-e0f03de5-b080-423f-be51-30089a85cecb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035493 Oct 30 00:52:10.268561 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 219/447] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:52:10.634275 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b5afa8d0-6c73-43fc-a95d-41f58f6c1dc9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:10.634911 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-b5afa8d0-6c73-43fc-a95d-41f58f6c1dc9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 070baf10-b612-4a7f-8697-18cd36dcf5c6] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:10.642469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5afa8d0-6c73-43fc-a95d-41f58f6c1dc9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:10.642949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5afa8d0-6c73-43fc-a95d-41f58f6c1dc9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:10.643377 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5afa8d0-6c73-43fc-a95d-41f58f6c1dc9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:10.644063 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5afa8d0-6c73-43fc-a95d-41f58f6c1dc9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:10.644529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5afa8d0-6c73-43fc-a95d-41f58f6c1dc9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:10.644947 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5afa8d0-6c73-43fc-a95d-41f58f6c1dc9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:10.777097 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b5afa8d0-6c73-43fc-a95d-41f58f6c1dc9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:10.786350 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b5afa8d0-6c73-43fc-a95d-41f58f6c1dc9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6" status: 200 len: 1314 microversion: 2.1 time: 0.155768 Oct 30 00:52:10.786913 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 229/448] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:10 2022] GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:11.379257 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d4d3f542-d330-441c-acbf-1106fbb364fb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:52:11.379895 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d4d3f542-d330-441c-acbf-1106fbb364fb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:11.386850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d4d3f542-d330-441c-acbf-1106fbb364fb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:11.387321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d4d3f542-d330-441c-acbf-1106fbb364fb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:11.387747 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d4d3f542-d330-441c-acbf-1106fbb364fb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:11.388456 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d4d3f542-d330-441c-acbf-1106fbb364fb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:11.388900 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d4d3f542-d330-441c-acbf-1106fbb364fb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:11.389309 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d4d3f542-d330-441c-acbf-1106fbb364fb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:11.412010 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.objects.instance [None req-d4d3f542-d330-441c-acbf-1106fbb364fb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lazy-loading 'flavor' on Instance uuid 00747eb3-1c2b-40b2-8e0a-9c440529e833 {{(pid=125553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:52:11.622538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d4d3f542-d330-441c-acbf-1106fbb364fb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "POST /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833/action" status: 202 len: 0 microversion: 2.20 time: 0.247351 Oct 30 00:52:11.623266 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 220/449] 10.222.0.36 () {62 vars in 1319 bytes} [Sun Oct 30 00:52:11 2022] POST /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:11.631657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-fd93634c-8df0-4f69-984a-2fe98c6115ea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:11.632212 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-fd93634c-8df0-4f69-984a-2fe98c6115ea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:11.638089 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fd93634c-8df0-4f69-984a-2fe98c6115ea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:11.638685 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fd93634c-8df0-4f69-984a-2fe98c6115ea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:11.638970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fd93634c-8df0-4f69-984a-2fe98c6115ea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:11.640092 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fd93634c-8df0-4f69-984a-2fe98c6115ea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:11.640212 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fd93634c-8df0-4f69-984a-2fe98c6115ea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:11.640568 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fd93634c-8df0-4f69-984a-2fe98c6115ea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:11.776186 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-fd93634c-8df0-4f69-984a-2fe98c6115ea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:11.785439 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-fd93634c-8df0-4f69-984a-2fe98c6115ea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:11.786850 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-fd93634c-8df0-4f69-984a-2fe98c6115ea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:11.787980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-fd93634c-8df0-4f69-984a-2fe98c6115ea tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.160229 Oct 30 00:52:11.788561 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 230/450] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:11 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:11.810400 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e5fab702-00c9-4018-bb87-3349e733b79d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:11.811140 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-e5fab702-00c9-4018-bb87-3349e733b79d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 070baf10-b612-4a7f-8697-18cd36dcf5c6] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:11.817383 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e5fab702-00c9-4018-bb87-3349e733b79d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:11.818109 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e5fab702-00c9-4018-bb87-3349e733b79d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:11.818534 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e5fab702-00c9-4018-bb87-3349e733b79d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:11.819209 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e5fab702-00c9-4018-bb87-3349e733b79d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:11.819662 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e5fab702-00c9-4018-bb87-3349e733b79d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:11.820075 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e5fab702-00c9-4018-bb87-3349e733b79d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:11.961089 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-e5fab702-00c9-4018-bb87-3349e733b79d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:11.969426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e5fab702-00c9-4018-bb87-3349e733b79d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6" status: 200 len: 1314 microversion: 2.1 time: 0.163494 Oct 30 00:52:11.969984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 221/451] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:11 2022] GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:12.813653 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-e855bcc6-df98-46a1-96a7-37bae721739d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:12.814371 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-e855bcc6-df98-46a1-96a7-37bae721739d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:12.816282 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:12.822636 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e855bcc6-df98-46a1-96a7-37bae721739d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:12.823150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e855bcc6-df98-46a1-96a7-37bae721739d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:12.823573 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e855bcc6-df98-46a1-96a7-37bae721739d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:12.824299 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e855bcc6-df98-46a1-96a7-37bae721739d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:12.824912 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e855bcc6-df98-46a1-96a7-37bae721739d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:12.825329 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e855bcc6-df98-46a1-96a7-37bae721739d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:12.965803 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e855bcc6-df98-46a1-96a7-37bae721739d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:12.976268 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e855bcc6-df98-46a1-96a7-37bae721739d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:12.976860 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e855bcc6-df98-46a1-96a7-37bae721739d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:12.978002 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-e855bcc6-df98-46a1-96a7-37bae721739d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.168378 Oct 30 00:52:12.978526 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 231/452] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:12 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:12.992592 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-0084eabd-41aa-41a8-ad7e-04ba682eb3ea tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:12.993510 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-0084eabd-41aa-41a8-ad7e-04ba682eb3ea tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 070baf10-b612-4a7f-8697-18cd36dcf5c6] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:13.003202 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0084eabd-41aa-41a8-ad7e-04ba682eb3ea tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:13.003697 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0084eabd-41aa-41a8-ad7e-04ba682eb3ea tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:13.004149 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0084eabd-41aa-41a8-ad7e-04ba682eb3ea tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:13.004853 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0084eabd-41aa-41a8-ad7e-04ba682eb3ea tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:13.005300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0084eabd-41aa-41a8-ad7e-04ba682eb3ea tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:13.005718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0084eabd-41aa-41a8-ad7e-04ba682eb3ea tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:13.142778 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-0084eabd-41aa-41a8-ad7e-04ba682eb3ea tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:13.150645 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-0084eabd-41aa-41a8-ad7e-04ba682eb3ea tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6" status: 200 len: 1314 microversion: 2.1 time: 0.162695 Oct 30 00:52:13.151187 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 222/453] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:12 2022] GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:14.005417 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-71d69344-c6a1-4d45-8c78-4b0c3572ee03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:14.006022 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-71d69344-c6a1-4d45-8c78-4b0c3572ee03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:14.011831 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-71d69344-c6a1-4d45-8c78-4b0c3572ee03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:14.012343 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-71d69344-c6a1-4d45-8c78-4b0c3572ee03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:14.012781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-71d69344-c6a1-4d45-8c78-4b0c3572ee03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:14.013470 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-71d69344-c6a1-4d45-8c78-4b0c3572ee03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:14.013923 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-71d69344-c6a1-4d45-8c78-4b0c3572ee03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:14.014347 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-71d69344-c6a1-4d45-8c78-4b0c3572ee03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:14.148948 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-71d69344-c6a1-4d45-8c78-4b0c3572ee03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:14.157884 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-71d69344-c6a1-4d45-8c78-4b0c3572ee03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:14.159336 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-71d69344-c6a1-4d45-8c78-4b0c3572ee03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:14.160509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-71d69344-c6a1-4d45-8c78-4b0c3572ee03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.158885 Oct 30 00:52:14.161149 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 232/454] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:14 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:14.175357 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-b599d7fe-645b-4df4-995c-7f9e8416a4b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:14.177379 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-b599d7fe-645b-4df4-995c-7f9e8416a4b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 070baf10-b612-4a7f-8697-18cd36dcf5c6] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:14.186212 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b599d7fe-645b-4df4-995c-7f9e8416a4b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:14.186841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b599d7fe-645b-4df4-995c-7f9e8416a4b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:14.187477 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b599d7fe-645b-4df4-995c-7f9e8416a4b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:14.188410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b599d7fe-645b-4df4-995c-7f9e8416a4b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:14.188911 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b599d7fe-645b-4df4-995c-7f9e8416a4b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:14.189322 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b599d7fe-645b-4df4-995c-7f9e8416a4b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:14.328355 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-b599d7fe-645b-4df4-995c-7f9e8416a4b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:14.335937 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-b599d7fe-645b-4df4-995c-7f9e8416a4b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6" status: 200 len: 1314 microversion: 2.1 time: 0.165931 Oct 30 00:52:14.336652 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 223/455] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:14 2022] GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:15.190893 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-9fd3ecca-e4f8-4a34-81b8-09d1584794cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:15.191613 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-9fd3ecca-e4f8-4a34-81b8-09d1584794cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:15.197894 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9fd3ecca-e4f8-4a34-81b8-09d1584794cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:15.198367 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9fd3ecca-e4f8-4a34-81b8-09d1584794cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:15.198791 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9fd3ecca-e4f8-4a34-81b8-09d1584794cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:15.199476 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9fd3ecca-e4f8-4a34-81b8-09d1584794cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:15.199918 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9fd3ecca-e4f8-4a34-81b8-09d1584794cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:15.200356 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9fd3ecca-e4f8-4a34-81b8-09d1584794cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:15.333050 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9fd3ecca-e4f8-4a34-81b8-09d1584794cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:15.340910 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9fd3ecca-e4f8-4a34-81b8-09d1584794cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:15.342319 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9fd3ecca-e4f8-4a34-81b8-09d1584794cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:15.344215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-9fd3ecca-e4f8-4a34-81b8-09d1584794cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.157654 Oct 30 00:52:15.344772 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 233/456] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:15 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:15.362604 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-2d12aaff-29a7-44a7-aa81-a20ec3980f85 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:15.363212 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-2d12aaff-29a7-44a7-aa81-a20ec3980f85 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 070baf10-b612-4a7f-8697-18cd36dcf5c6] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:15.369823 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2d12aaff-29a7-44a7-aa81-a20ec3980f85 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:15.370303 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2d12aaff-29a7-44a7-aa81-a20ec3980f85 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:15.370755 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2d12aaff-29a7-44a7-aa81-a20ec3980f85 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:15.371462 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2d12aaff-29a7-44a7-aa81-a20ec3980f85 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:15.371905 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2d12aaff-29a7-44a7-aa81-a20ec3980f85 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:15.372343 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2d12aaff-29a7-44a7-aa81-a20ec3980f85 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:15.508637 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-2d12aaff-29a7-44a7-aa81-a20ec3980f85 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:15.516310 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-2d12aaff-29a7-44a7-aa81-a20ec3980f85 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6" status: 200 len: 1314 microversion: 2.1 time: 0.158061 Oct 30 00:52:15.516861 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 224/457] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:15 2022] GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:16.371542 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b24fce84-df58-4bf6-8b4e-64884f53bf1a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:16.372747 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-b24fce84-df58-4bf6-8b4e-64884f53bf1a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:16.379715 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b24fce84-df58-4bf6-8b4e-64884f53bf1a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:16.380230 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b24fce84-df58-4bf6-8b4e-64884f53bf1a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:16.380691 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b24fce84-df58-4bf6-8b4e-64884f53bf1a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:16.381390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b24fce84-df58-4bf6-8b4e-64884f53bf1a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:16.381840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b24fce84-df58-4bf6-8b4e-64884f53bf1a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:16.382276 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b24fce84-df58-4bf6-8b4e-64884f53bf1a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:16.521589 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b24fce84-df58-4bf6-8b4e-64884f53bf1a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:16.529993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b24fce84-df58-4bf6-8b4e-64884f53bf1a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:16.531970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b24fce84-df58-4bf6-8b4e-64884f53bf1a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:16.533164 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b24fce84-df58-4bf6-8b4e-64884f53bf1a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.165989 Oct 30 00:52:16.533740 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 234/458] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:16 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:16.538893 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c813bc57-9150-4b9b-b13a-91518b9d7cf9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:16.539584 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-c813bc57-9150-4b9b-b13a-91518b9d7cf9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 070baf10-b612-4a7f-8697-18cd36dcf5c6] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:16.547120 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c813bc57-9150-4b9b-b13a-91518b9d7cf9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:16.547685 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c813bc57-9150-4b9b-b13a-91518b9d7cf9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:16.548236 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c813bc57-9150-4b9b-b13a-91518b9d7cf9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:16.548938 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c813bc57-9150-4b9b-b13a-91518b9d7cf9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:16.549386 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c813bc57-9150-4b9b-b13a-91518b9d7cf9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:16.549811 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c813bc57-9150-4b9b-b13a-91518b9d7cf9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:16.552569 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:16.684894 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c813bc57-9150-4b9b-b13a-91518b9d7cf9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:16.694148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c813bc57-9150-4b9b-b13a-91518b9d7cf9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6" status: 200 len: 1314 microversion: 2.1 time: 0.159243 Oct 30 00:52:16.694693 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 225/459] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:16 2022] GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:17.558309 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-eb8ca512-9205-42a1-ae60-d70d65d8da6a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:17.558907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-eb8ca512-9205-42a1-ae60-d70d65d8da6a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:17.560736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=2 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:17.561375 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=6 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:17.567137 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-eb8ca512-9205-42a1-ae60-d70d65d8da6a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:17.567607 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-eb8ca512-9205-42a1-ae60-d70d65d8da6a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:17.568310 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-eb8ca512-9205-42a1-ae60-d70d65d8da6a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:17.568986 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-eb8ca512-9205-42a1-ae60-d70d65d8da6a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:17.569433 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-eb8ca512-9205-42a1-ae60-d70d65d8da6a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:17.569843 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-eb8ca512-9205-42a1-ae60-d70d65d8da6a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:17.700642 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-eb8ca512-9205-42a1-ae60-d70d65d8da6a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:17.709199 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-eb8ca512-9205-42a1-ae60-d70d65d8da6a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:17.710621 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-eb8ca512-9205-42a1-ae60-d70d65d8da6a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:17.711778 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-eb8ca512-9205-42a1-ae60-d70d65d8da6a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.157326 Oct 30 00:52:17.712419 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 235/460] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:17 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:17.717117 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-003797f5-8d7e-4c02-9ccd-88c63ecdc6d2 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:17.717728 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-003797f5-8d7e-4c02-9ccd-88c63ecdc6d2 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 070baf10-b612-4a7f-8697-18cd36dcf5c6] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:17.719701 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=2 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:17.726033 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-003797f5-8d7e-4c02-9ccd-88c63ecdc6d2 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:17.727637 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-003797f5-8d7e-4c02-9ccd-88c63ecdc6d2 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:17.728108 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-003797f5-8d7e-4c02-9ccd-88c63ecdc6d2 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:17.728889 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-003797f5-8d7e-4c02-9ccd-88c63ecdc6d2 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:17.729344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-003797f5-8d7e-4c02-9ccd-88c63ecdc6d2 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:17.729806 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-003797f5-8d7e-4c02-9ccd-88c63ecdc6d2 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:17.861080 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-003797f5-8d7e-4c02-9ccd-88c63ecdc6d2 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:17.868653 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-003797f5-8d7e-4c02-9ccd-88c63ecdc6d2 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6" status: 200 len: 1314 microversion: 2.1 time: 0.155445 Oct 30 00:52:17.874001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 226/461] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:17 2022] GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:52:18.569761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-2229c684-ea12-4920-9b1a-ad0def56271e req-50afa253-6a9d-49fd-9981-6fade48a4ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "070baf10-b612-4a7f-8697-18cd36dcf5c6", "name": "network-vif-plugged", "status": "completed", "tag": "f7e7fc0b-4154-4003-82d6-1fd31a77c5f0"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:52:18.580235 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-2229c684-ea12-4920-9b1a-ad0def56271e req-50afa253-6a9d-49fd-9981-6fade48a4ac9 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:18.580713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-2229c684-ea12-4920-9b1a-ad0def56271e req-50afa253-6a9d-49fd-9981-6fade48a4ac9 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:18.581140 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-2229c684-ea12-4920-9b1a-ad0def56271e req-50afa253-6a9d-49fd-9981-6fade48a4ac9 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:18.592255 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-2229c684-ea12-4920-9b1a-ad0def56271e req-50afa253-6a9d-49fd-9981-6fade48a4ac9 service nova] Creating event network-vif-plugged:f7e7fc0b-4154-4003-82d6-1fd31a77c5f0 for instance 070baf10-b612-4a7f-8697-18cd36dcf5c6 on hv-cinder-86149 Oct 30 00:52:18.598172 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-2229c684-ea12-4920-9b1a-ad0def56271e req-50afa253-6a9d-49fd-9981-6fade48a4ac9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032329 Oct 30 00:52:18.598791 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 236/462] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:52:18.737232 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a792eaf9-0ba6-44eb-8814-163bbf09bf76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:18.737827 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a792eaf9-0ba6-44eb-8814-163bbf09bf76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:18.744417 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a792eaf9-0ba6-44eb-8814-163bbf09bf76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:18.744894 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a792eaf9-0ba6-44eb-8814-163bbf09bf76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:18.745430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a792eaf9-0ba6-44eb-8814-163bbf09bf76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:18.746226 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a792eaf9-0ba6-44eb-8814-163bbf09bf76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:18.746870 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a792eaf9-0ba6-44eb-8814-163bbf09bf76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:18.747302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a792eaf9-0ba6-44eb-8814-163bbf09bf76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:18.887549 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a792eaf9-0ba6-44eb-8814-163bbf09bf76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:18.896751 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b291335a-2a8a-481d-b3b6-31142dad8e45 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:18.897651 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a792eaf9-0ba6-44eb-8814-163bbf09bf76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:18.897803 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-b291335a-2a8a-481d-b3b6-31142dad8e45 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 070baf10-b612-4a7f-8697-18cd36dcf5c6] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:18.899079 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a792eaf9-0ba6-44eb-8814-163bbf09bf76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:18.900333 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a792eaf9-0ba6-44eb-8814-163bbf09bf76 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.167285 Oct 30 00:52:18.900878 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 227/463] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:18 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:18.903926 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b291335a-2a8a-481d-b3b6-31142dad8e45 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:18.904541 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b291335a-2a8a-481d-b3b6-31142dad8e45 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:18.904871 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b291335a-2a8a-481d-b3b6-31142dad8e45 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:18.905570 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b291335a-2a8a-481d-b3b6-31142dad8e45 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:18.906022 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b291335a-2a8a-481d-b3b6-31142dad8e45 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:18.906445 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b291335a-2a8a-481d-b3b6-31142dad8e45 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:19.036781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b291335a-2a8a-481d-b3b6-31142dad8e45 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:19.044322 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b291335a-2a8a-481d-b3b6-31142dad8e45 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6" status: 200 len: 1314 microversion: 2.1 time: 0.151663 Oct 30 00:52:19.044876 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 237/464] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:18 2022] GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:52:19.926543 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f15e1a34-9049-4618-af4a-61b21143100b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:19.927162 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f15e1a34-9049-4618-af4a-61b21143100b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:19.933517 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f15e1a34-9049-4618-af4a-61b21143100b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:19.933986 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f15e1a34-9049-4618-af4a-61b21143100b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:19.934410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f15e1a34-9049-4618-af4a-61b21143100b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:19.935084 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f15e1a34-9049-4618-af4a-61b21143100b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:19.935524 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f15e1a34-9049-4618-af4a-61b21143100b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:19.935936 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f15e1a34-9049-4618-af4a-61b21143100b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:20.067175 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2692dda4-7f4b-431d-9f23-d536042369e7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:20.068440 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f15e1a34-9049-4618-af4a-61b21143100b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:20.070529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2692dda4-7f4b-431d-9f23-d536042369e7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 070baf10-b612-4a7f-8697-18cd36dcf5c6] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:20.076647 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2692dda4-7f4b-431d-9f23-d536042369e7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:20.077120 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2692dda4-7f4b-431d-9f23-d536042369e7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:20.077225 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f15e1a34-9049-4618-af4a-61b21143100b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:20.077544 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2692dda4-7f4b-431d-9f23-d536042369e7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:20.078225 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2692dda4-7f4b-431d-9f23-d536042369e7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:20.078559 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f15e1a34-9049-4618-af4a-61b21143100b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:20.078682 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2692dda4-7f4b-431d-9f23-d536042369e7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:20.079070 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2692dda4-7f4b-431d-9f23-d536042369e7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:20.080620 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f15e1a34-9049-4618-af4a-61b21143100b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.158770 Oct 30 00:52:20.081409 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 228/465] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:19 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:20.211166 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2692dda4-7f4b-431d-9f23-d536042369e7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:20.218649 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2692dda4-7f4b-431d-9f23-d536042369e7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6" status: 200 len: 1314 microversion: 2.1 time: 0.155872 Oct 30 00:52:20.219209 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 238/466] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:20 2022] GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:52:21.106331 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a5d74a0b-bf21-41a2-b7d9-06868731b6eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:21.106967 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a5d74a0b-bf21-41a2-b7d9-06868731b6eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:21.109313 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=62 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:21.114985 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a5d74a0b-bf21-41a2-b7d9-06868731b6eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:21.115464 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a5d74a0b-bf21-41a2-b7d9-06868731b6eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:21.115892 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a5d74a0b-bf21-41a2-b7d9-06868731b6eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:21.117364 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a5d74a0b-bf21-41a2-b7d9-06868731b6eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:21.117816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a5d74a0b-bf21-41a2-b7d9-06868731b6eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:21.118240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a5d74a0b-bf21-41a2-b7d9-06868731b6eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:21.241667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-caefcbe4-adf2-4735-a7f4-a0978a8520c3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:21.242386 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-caefcbe4-adf2-4735-a7f4-a0978a8520c3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 070baf10-b612-4a7f-8697-18cd36dcf5c6] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:21.246429 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a5d74a0b-bf21-41a2-b7d9-06868731b6eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:21.248510 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-caefcbe4-adf2-4735-a7f4-a0978a8520c3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:21.248991 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-caefcbe4-adf2-4735-a7f4-a0978a8520c3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:21.249419 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-caefcbe4-adf2-4735-a7f4-a0978a8520c3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:21.250106 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-caefcbe4-adf2-4735-a7f4-a0978a8520c3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:21.250553 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-caefcbe4-adf2-4735-a7f4-a0978a8520c3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:21.250971 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-caefcbe4-adf2-4735-a7f4-a0978a8520c3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:21.254627 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a5d74a0b-bf21-41a2-b7d9-06868731b6eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:21.256116 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a5d74a0b-bf21-41a2-b7d9-06868731b6eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:21.257271 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a5d74a0b-bf21-41a2-b7d9-06868731b6eb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.154851 Oct 30 00:52:21.257821 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 229/467] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:21 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:21.381890 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-caefcbe4-adf2-4735-a7f4-a0978a8520c3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:21.389764 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-caefcbe4-adf2-4735-a7f4-a0978a8520c3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6" status: 200 len: 1497 microversion: 2.1 time: 0.151895 Oct 30 00:52:21.400847 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 239/468] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:21 2022] GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6 => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:52:22.015403 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-893b99c2-9aab-4a00-a6e9-aca1d9f630c7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:22.015892 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-893b99c2-9aab-4a00-a6e9-aca1d9f630c7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 070baf10-b612-4a7f-8697-18cd36dcf5c6] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:22.021806 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-893b99c2-9aab-4a00-a6e9-aca1d9f630c7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:22.022281 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-893b99c2-9aab-4a00-a6e9-aca1d9f630c7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:22.022697 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-893b99c2-9aab-4a00-a6e9-aca1d9f630c7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:22.023377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-893b99c2-9aab-4a00-a6e9-aca1d9f630c7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:22.023807 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-893b99c2-9aab-4a00-a6e9-aca1d9f630c7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:22.024250 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-893b99c2-9aab-4a00-a6e9-aca1d9f630c7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:22.047864 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-893b99c2-9aab-4a00-a6e9-aca1d9f630c7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 070baf10-b612-4a7f-8697-18cd36dcf5c6] Going to try to terminate instance {{(pid=125553) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 00:52:22.123883 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-893b99c2-9aab-4a00-a6e9-aca1d9f630c7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "DELETE /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6" status: 204 len: 0 microversion: 2.1 time: 0.111927 Oct 30 00:52:22.124990 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 230/469] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 00:52:22 2022] DELETE /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:22.135722 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-6fec34f7-acc0-4a63-a94f-922862be8430 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:22.136361 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-6fec34f7-acc0-4a63-a94f-922862be8430 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 070baf10-b612-4a7f-8697-18cd36dcf5c6] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:22.142352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6fec34f7-acc0-4a63-a94f-922862be8430 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:22.142826 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6fec34f7-acc0-4a63-a94f-922862be8430 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:22.143257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6fec34f7-acc0-4a63-a94f-922862be8430 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:22.143944 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6fec34f7-acc0-4a63-a94f-922862be8430 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:22.144433 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6fec34f7-acc0-4a63-a94f-922862be8430 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:22.144853 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6fec34f7-acc0-4a63-a94f-922862be8430 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:22.274657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6fec34f7-acc0-4a63-a94f-922862be8430 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:22.282931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-6fec34f7-acc0-4a63-a94f-922862be8430 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6" status: 200 len: 1503 microversion: 2.1 time: 0.150688 Oct 30 00:52:22.284383 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 240/470] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:22 2022] GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:22.284512 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-674c3904-4749-4ff5-8342-6eb915060183 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:22.285297 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-674c3904-4749-4ff5-8342-6eb915060183 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:22.291289 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-674c3904-4749-4ff5-8342-6eb915060183 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:22.291768 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-674c3904-4749-4ff5-8342-6eb915060183 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:22.292223 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-674c3904-4749-4ff5-8342-6eb915060183 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:22.292921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-674c3904-4749-4ff5-8342-6eb915060183 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:22.293401 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-674c3904-4749-4ff5-8342-6eb915060183 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:22.293824 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-674c3904-4749-4ff5-8342-6eb915060183 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:22.425313 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-674c3904-4749-4ff5-8342-6eb915060183 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:22.433331 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-674c3904-4749-4ff5-8342-6eb915060183 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:22.434777 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-674c3904-4749-4ff5-8342-6eb915060183 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:22.435928 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-674c3904-4749-4ff5-8342-6eb915060183 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.157268 Oct 30 00:52:22.436516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 231/471] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:22 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:52:23.306657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-bd5f1974-73bb-4284-90b2-b878a39f224d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:23.307291 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-bd5f1974-73bb-4284-90b2-b878a39f224d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 070baf10-b612-4a7f-8697-18cd36dcf5c6] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:23.313259 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bd5f1974-73bb-4284-90b2-b878a39f224d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:23.314431 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bd5f1974-73bb-4284-90b2-b878a39f224d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:23.314954 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bd5f1974-73bb-4284-90b2-b878a39f224d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:23.315669 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bd5f1974-73bb-4284-90b2-b878a39f224d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:23.316146 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bd5f1974-73bb-4284-90b2-b878a39f224d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:23.316567 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bd5f1974-73bb-4284-90b2-b878a39f224d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:23.337204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=100 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:23.448773 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-bd5f1974-73bb-4284-90b2-b878a39f224d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:23.456678 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-bd5f1974-73bb-4284-90b2-b878a39f224d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6" status: 200 len: 1503 microversion: 2.1 time: 0.153824 Oct 30 00:52:23.457235 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 241/472] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:23 2022] GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:23.461466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a94c58e9-1533-4035-90ae-7a5f43cf45c1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:23.462105 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a94c58e9-1533-4035-90ae-7a5f43cf45c1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:23.468196 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a94c58e9-1533-4035-90ae-7a5f43cf45c1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:23.468669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a94c58e9-1533-4035-90ae-7a5f43cf45c1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:23.469094 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a94c58e9-1533-4035-90ae-7a5f43cf45c1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:23.469768 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a94c58e9-1533-4035-90ae-7a5f43cf45c1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:23.470278 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a94c58e9-1533-4035-90ae-7a5f43cf45c1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:23.470787 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a94c58e9-1533-4035-90ae-7a5f43cf45c1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:23.602469 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a94c58e9-1533-4035-90ae-7a5f43cf45c1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:23.611238 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a94c58e9-1533-4035-90ae-7a5f43cf45c1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:23.612716 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a94c58e9-1533-4035-90ae-7a5f43cf45c1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:23.613857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a94c58e9-1533-4035-90ae-7a5f43cf45c1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.156133 Oct 30 00:52:23.614425 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 232/473] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:23 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:52:24.481122 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4aa453b2-2f10-4cee-985b-a16b7a68c2e4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:24.481726 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-4aa453b2-2f10-4cee-985b-a16b7a68c2e4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 070baf10-b612-4a7f-8697-18cd36dcf5c6] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:24.487775 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4aa453b2-2f10-4cee-985b-a16b7a68c2e4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:24.488292 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4aa453b2-2f10-4cee-985b-a16b7a68c2e4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:24.488723 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4aa453b2-2f10-4cee-985b-a16b7a68c2e4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:24.489398 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4aa453b2-2f10-4cee-985b-a16b7a68c2e4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:24.489843 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4aa453b2-2f10-4cee-985b-a16b7a68c2e4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:24.490264 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4aa453b2-2f10-4cee-985b-a16b7a68c2e4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:24.621042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4aa453b2-2f10-4cee-985b-a16b7a68c2e4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:24.630148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-4aa453b2-2f10-4cee-985b-a16b7a68c2e4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6" status: 200 len: 1503 microversion: 2.1 time: 0.153951 Oct 30 00:52:24.630716 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 242/474] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:24 2022] GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:24.638611 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-fbf65854-5976-42fb-b2d4-0c5524deebee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:24.639216 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-fbf65854-5976-42fb-b2d4-0c5524deebee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:24.646505 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbf65854-5976-42fb-b2d4-0c5524deebee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:24.646986 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbf65854-5976-42fb-b2d4-0c5524deebee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:24.647422 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbf65854-5976-42fb-b2d4-0c5524deebee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:24.648133 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbf65854-5976-42fb-b2d4-0c5524deebee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:24.648582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbf65854-5976-42fb-b2d4-0c5524deebee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:24.649001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbf65854-5976-42fb-b2d4-0c5524deebee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:24.779126 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fbf65854-5976-42fb-b2d4-0c5524deebee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:24.787236 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fbf65854-5976-42fb-b2d4-0c5524deebee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:24.788727 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fbf65854-5976-42fb-b2d4-0c5524deebee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:24.789875 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-fbf65854-5976-42fb-b2d4-0c5524deebee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.155195 Oct 30 00:52:24.790431 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 233/475] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:24 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:52:25.325184 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-8b5f5b38-a6ba-4d62-aaee-bfebc37a6cd7 req-20254f6f-d6e1-499f-bb67-21631f062650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "070baf10-b612-4a7f-8697-18cd36dcf5c6", "name": "network-vif-deleted", "tag": "f7e7fc0b-4154-4003-82d6-1fd31a77c5f0"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:52:25.335053 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-8b5f5b38-a6ba-4d62-aaee-bfebc37a6cd7 req-20254f6f-d6e1-499f-bb67-21631f062650 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:25.335535 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-8b5f5b38-a6ba-4d62-aaee-bfebc37a6cd7 req-20254f6f-d6e1-499f-bb67-21631f062650 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:25.335949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-8b5f5b38-a6ba-4d62-aaee-bfebc37a6cd7 req-20254f6f-d6e1-499f-bb67-21631f062650 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:25.349580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-8b5f5b38-a6ba-4d62-aaee-bfebc37a6cd7 req-20254f6f-d6e1-499f-bb67-21631f062650 service nova] Creating event network-vif-deleted:f7e7fc0b-4154-4003-82d6-1fd31a77c5f0 for instance 070baf10-b612-4a7f-8697-18cd36dcf5c6 on hv-cinder-86149 Oct 30 00:52:25.355524 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-8b5f5b38-a6ba-4d62-aaee-bfebc37a6cd7 req-20254f6f-d6e1-499f-bb67-21631f062650 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033910 Oct 30 00:52:25.356325 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 243/476] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:52:25.653575 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-6ae8bc27-1d45-4720-ada8-32ea79670039 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:25.654337 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-6ae8bc27-1d45-4720-ada8-32ea79670039 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 070baf10-b612-4a7f-8697-18cd36dcf5c6] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:25.661660 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6ae8bc27-1d45-4720-ada8-32ea79670039 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:25.662145 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6ae8bc27-1d45-4720-ada8-32ea79670039 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:25.662578 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6ae8bc27-1d45-4720-ada8-32ea79670039 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:25.663307 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6ae8bc27-1d45-4720-ada8-32ea79670039 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:25.663755 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6ae8bc27-1d45-4720-ada8-32ea79670039 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:25.664209 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6ae8bc27-1d45-4720-ada8-32ea79670039 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:25.697785 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6ae8bc27-1d45-4720-ada8-32ea79670039 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:25.698270 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6ae8bc27-1d45-4720-ada8-32ea79670039 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:25.698706 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6ae8bc27-1d45-4720-ada8-32ea79670039 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:25.699150 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.objects.instance [None req-6ae8bc27-1d45-4720-ada8-32ea79670039 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lazy-loading 'fault' on Instance uuid 070baf10-b612-4a7f-8697-18cd36dcf5c6 {{(pid=125553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:52:25.743322 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-6ae8bc27-1d45-4720-ada8-32ea79670039 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:25.752462 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-6ae8bc27-1d45-4720-ada8-32ea79670039 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6" status: 200 len: 1304 microversion: 2.1 time: 0.102782 Oct 30 00:52:25.753027 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 234/477] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:25 2022] GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:25.815205 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4789df77-75a4-4a45-922c-7f5b310c75a2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:25.815884 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-4789df77-75a4-4a45-922c-7f5b310c75a2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:25.822158 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4789df77-75a4-4a45-922c-7f5b310c75a2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:25.822628 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4789df77-75a4-4a45-922c-7f5b310c75a2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:25.823052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4789df77-75a4-4a45-922c-7f5b310c75a2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:25.823725 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4789df77-75a4-4a45-922c-7f5b310c75a2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:25.824188 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4789df77-75a4-4a45-922c-7f5b310c75a2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:25.824603 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4789df77-75a4-4a45-922c-7f5b310c75a2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:25.952872 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4789df77-75a4-4a45-922c-7f5b310c75a2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:25.961960 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4789df77-75a4-4a45-922c-7f5b310c75a2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:25.963369 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4789df77-75a4-4a45-922c-7f5b310c75a2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:25.964531 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-4789df77-75a4-4a45-922c-7f5b310c75a2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.153612 Oct 30 00:52:25.965097 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 244/478] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:25 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:26.775815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d407bd39-0844-4f1a-8350-6b1e08a56008 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:26.777045 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d407bd39-0844-4f1a-8350-6b1e08a56008 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 070baf10-b612-4a7f-8697-18cd36dcf5c6] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:26.783977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d407bd39-0844-4f1a-8350-6b1e08a56008 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:26.784490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d407bd39-0844-4f1a-8350-6b1e08a56008 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:26.784917 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d407bd39-0844-4f1a-8350-6b1e08a56008 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:26.785602 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d407bd39-0844-4f1a-8350-6b1e08a56008 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:26.786052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d407bd39-0844-4f1a-8350-6b1e08a56008 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:26.786470 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d407bd39-0844-4f1a-8350-6b1e08a56008 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:26.800446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-d407bd39-0844-4f1a-8350-6b1e08a56008 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] HTTP exception thrown: Instance 070baf10-b612-4a7f-8697-18cd36dcf5c6 could not be found. Oct 30 00:52:26.802052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d407bd39-0844-4f1a-8350-6b1e08a56008 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Request method failure captured: Oct 30 00:52:26.802052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6 HTTP/1.1 Oct 30 00:52:26.802052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 00:52:26.802052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 00:52:26.802052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 00:52:26.802052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 00:52:26.802052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 00:52:26.802052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 00:52:26.802052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 00:52:26.802052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 00:52:26.802052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXcq0ThAOvfsU4S7kAUGJN3sZ0r8T80qDSFNZbNVsRJItsj_DHAm7p2__MmlinQuQyOmkm7WIpaHaGAncNVclUmnpyqfquIiIG_Mj7zM0aBLCaGEor81VlJo66YItzmOtdJNOyGAOYs176suc5PvBR9iE8u8tUMYdLO0BgXJ8zrxWD_c Oct 30 00:52:26.802052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 00:52:26.802052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 00:52:26.802052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 00:52:26.802052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 00:52:26.802052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 00:52:26.802052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 00:52:26.802052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: d870a579f94748d1998b1902b9dc8636 Oct 30 00:52:26.802052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-VolumesActionsTest-1632664077 Oct 30 00:52:26.802052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 00:52:26.802052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 00:52:26.803553 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d870a579f94748d1998b1902b9dc8636"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d870a579f94748d1998b1902b9dc8636"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d870a579f94748d1998b1902b9dc8636"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d870a579f94748d1998b1902b9dc8636"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:52:26.803553 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-VolumesActionsTest-1632664077 Oct 30 00:52:26.803553 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: d870a579f94748d1998b1902b9dc8636 Oct 30 00:52:26.803553 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-VolumesActionsTest-1632664077 Oct 30 00:52:26.803553 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-VolumesActionsTest-1632664077-project Oct 30 00:52:26.803553 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 00:52:26.803553 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 00:52:26.803553 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: b8b8683a89f043b792dc6ba73af2d22b Oct 30 00:52:26.803553 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-VolumesActionsTest-1632664077-project Oct 30 00:52:26.803553 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: > Oct 30 00:52:26.803553 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Instance 070baf10-b612-4a7f-8697-18cd36dcf5c6 could not be found. Oct 30 00:52:26.803553 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': '070baf10-b612-4a7f-8697-18cd36dcf5c6'} Oct 30 00:52:26.804410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:52:26.804410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:52:26.804410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:52:26.804410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:52:26.804410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:52:26.804410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:52:26.804410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:52:26.804410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:52:26.804410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:52:26.804410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:52:26.804410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 070baf10-b612-4a7f-8697-18cd36dcf5c6 could not be found. Oct 30 00:52:26.804410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:52:26.804410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:52:26.804410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:52:26.804410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:52:26.804410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:52:26.804410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:52:26.804410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:52:26.804410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:52:26.804410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:52:26.805843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:52:26.805843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 00:52:26.805843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 00:52:26.805843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:52:26.805843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:52:26.805843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:52:26.805843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:52:26.805843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 070baf10-b612-4a7f-8697-18cd36dcf5c6 could not be found. Oct 30 00:52:26.805843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:52:26.805843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:52:26.805843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:52:26.805843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:52:26.805843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:52:26.805843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:52:26.805843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:52:26.805843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:52:26.805843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 070baf10-b612-4a7f-8697-18cd36dcf5c6 could not be found. Oct 30 00:52:26.805843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:52:26.807109 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d407bd39-0844-4f1a-8350-6b1e08a56008 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Returning 404 to user: Instance 070baf10-b612-4a7f-8697-18cd36dcf5c6 could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:52:26.807109 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d407bd39-0844-4f1a-8350-6b1e08a56008 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6" status: 404 len: 111 microversion: 2.1 time: 0.031500 Oct 30 00:52:26.807109 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 235/479] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:26 2022] GET /compute/v2.1/servers/070baf10-b612-4a7f-8697-18cd36dcf5c6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 00:52:26.853136 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f8cda10e-a277-45f1-a963-5afeb1a732a4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1209562300", "imageRef": "27983dee-4bd6-4aad-9c28-22bd5382709a", "flavorRef": "452", "networks": [{"uuid": "55bb4c66-29fe-45a7-9f60-8b370dd9914f"}]}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:52:26.908036 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.network.neutron [None req-f8cda10e-a277-45f1-a963-5afeb1a732a4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] validate_networks() for [('55bb4c66-29fe-45a7-9f60-8b370dd9914f', None, None, None, None, None)] {{(pid=125554) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 00:52:26.990932 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5591e565-4411-431e-ae15-6a0490107671 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:26.991584 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5591e565-4411-431e-ae15-6a0490107671 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:26.997489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5591e565-4411-431e-ae15-6a0490107671 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:26.997970 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5591e565-4411-431e-ae15-6a0490107671 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:26.998405 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5591e565-4411-431e-ae15-6a0490107671 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:26.999099 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5591e565-4411-431e-ae15-6a0490107671 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:26.999550 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5591e565-4411-431e-ae15-6a0490107671 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:26.999977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5591e565-4411-431e-ae15-6a0490107671 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:27.424343 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5591e565-4411-431e-ae15-6a0490107671 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:27.432620 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5591e565-4411-431e-ae15-6a0490107671 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:27.434159 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5591e565-4411-431e-ae15-6a0490107671 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:27.435331 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5591e565-4411-431e-ae15-6a0490107671 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.448284 Oct 30 00:52:27.435866 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 236/480] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:26 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:27.532863 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-f8cda10e-a277-45f1-a963-5afeb1a732a4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Flavor limits 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 00:52:27.533560 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-f8cda10e-a277-45f1-a963-5afeb1a732a4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Image limits 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 00:52:27.534120 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-f8cda10e-a277-45f1-a963-5afeb1a732a4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Flavor pref 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 00:52:27.534561 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-f8cda10e-a277-45f1-a963-5afeb1a732a4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Image pref 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 00:52:27.535007 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-f8cda10e-a277-45f1-a963-5afeb1a732a4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 00:52:27.543749 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f8cda10e-a277-45f1-a963-5afeb1a732a4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:27.544261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f8cda10e-a277-45f1-a963-5afeb1a732a4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:27.544696 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f8cda10e-a277-45f1-a963-5afeb1a732a4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:27.545417 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f8cda10e-a277-45f1-a963-5afeb1a732a4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:27.545866 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f8cda10e-a277-45f1-a963-5afeb1a732a4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:27.546285 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f8cda10e-a277-45f1-a963-5afeb1a732a4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:27.563126 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-f8cda10e-a277-45f1-a963-5afeb1a732a4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Getting quotas for project d870a579f94748d1998b1902b9dc8636. Resources: {'instances', 'cores', 'ram'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 00:52:27.567908 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-f8cda10e-a277-45f1-a963-5afeb1a732a4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Getting quotas for user b8b8683a89f043b792dc6ba73af2d22b and project d870a579f94748d1998b1902b9dc8636. Resources: {'instances', 'cores', 'ram'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 00:52:27.579953 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-f8cda10e-a277-45f1-a963-5afeb1a732a4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Going to run 1 instances... {{(pid=125554) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 00:52:27.582265 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-f8cda10e-a277-45f1-a963-5afeb1a732a4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27983dee-4bd6-4aad-9c28-22bd5382709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125554) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 00:52:27.629874 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-f8cda10e-a277-45f1-a963-5afeb1a732a4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.780410 Oct 30 00:52:27.630590 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 245/481] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Oct 30 00:52:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 00:52:27.644666 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-06575b3e-d521-4fa5-a628-0c55af55fd55 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:27.645403 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-06575b3e-d521-4fa5-a628-0c55af55fd55 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:27.705587 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-06575b3e-d521-4fa5-a628-0c55af55fd55 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:27.715948 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-06575b3e-d521-4fa5-a628-0c55af55fd55 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1214 microversion: 2.1 time: 0.076277 Oct 30 00:52:27.715948 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 237/482] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:27 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:28.461962 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-3c2e4703-14d6-4610-b224-288a30f0f098 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:28.462566 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-3c2e4703-14d6-4610-b224-288a30f0f098 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:28.469468 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3c2e4703-14d6-4610-b224-288a30f0f098 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:28.469980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3c2e4703-14d6-4610-b224-288a30f0f098 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:28.470415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3c2e4703-14d6-4610-b224-288a30f0f098 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:28.471113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3c2e4703-14d6-4610-b224-288a30f0f098 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:28.472043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3c2e4703-14d6-4610-b224-288a30f0f098 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:28.472496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3c2e4703-14d6-4610-b224-288a30f0f098 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:28.611680 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-3c2e4703-14d6-4610-b224-288a30f0f098 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:28.620117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-3c2e4703-14d6-4610-b224-288a30f0f098 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:28.621541 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-3c2e4703-14d6-4610-b224-288a30f0f098 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:28.622673 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-3c2e4703-14d6-4610-b224-288a30f0f098 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.164686 Oct 30 00:52:28.623211 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 246/483] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:28 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:28.738794 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d920e2ee-cae3-45d4-80ef-d0659cd06f28 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:28.739403 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d920e2ee-cae3-45d4-80ef-d0659cd06f28 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:28.745891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d920e2ee-cae3-45d4-80ef-d0659cd06f28 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:28.746376 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d920e2ee-cae3-45d4-80ef-d0659cd06f28 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:28.746815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d920e2ee-cae3-45d4-80ef-d0659cd06f28 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:28.747505 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d920e2ee-cae3-45d4-80ef-d0659cd06f28 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:28.747960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d920e2ee-cae3-45d4-80ef-d0659cd06f28 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:28.748413 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d920e2ee-cae3-45d4-80ef-d0659cd06f28 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:28.810436 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d920e2ee-cae3-45d4-80ef-d0659cd06f28 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:28.819936 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d920e2ee-cae3-45d4-80ef-d0659cd06f28 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1266 microversion: 2.1 time: 0.085719 Oct 30 00:52:28.820626 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 238/484] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:28 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:29.649348 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b08201ea-13f8-4792-a255-5c582ef56900 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:29.649887 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-b08201ea-13f8-4792-a255-5c582ef56900 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:29.655851 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b08201ea-13f8-4792-a255-5c582ef56900 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:29.656354 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b08201ea-13f8-4792-a255-5c582ef56900 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:29.656784 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b08201ea-13f8-4792-a255-5c582ef56900 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:29.657990 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b08201ea-13f8-4792-a255-5c582ef56900 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:29.658485 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b08201ea-13f8-4792-a255-5c582ef56900 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:29.658925 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b08201ea-13f8-4792-a255-5c582ef56900 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:29.793100 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b08201ea-13f8-4792-a255-5c582ef56900 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:29.803273 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b08201ea-13f8-4792-a255-5c582ef56900 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:29.804880 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b08201ea-13f8-4792-a255-5c582ef56900 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:29.806028 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b08201ea-13f8-4792-a255-5c582ef56900 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.160700 Oct 30 00:52:29.806603 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 247/485] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:29 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:29.842932 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-b31f2923-cae9-4d03-a672-d8cac34e8dce tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:29.843545 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-b31f2923-cae9-4d03-a672-d8cac34e8dce tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:29.850521 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b31f2923-cae9-4d03-a672-d8cac34e8dce tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:29.851175 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b31f2923-cae9-4d03-a672-d8cac34e8dce tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:29.851474 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b31f2923-cae9-4d03-a672-d8cac34e8dce tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:29.852786 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b31f2923-cae9-4d03-a672-d8cac34e8dce tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:29.853243 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b31f2923-cae9-4d03-a672-d8cac34e8dce tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:29.853667 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b31f2923-cae9-4d03-a672-d8cac34e8dce tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:29.928711 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-b31f2923-cae9-4d03-a672-d8cac34e8dce tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:29.936285 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-b31f2923-cae9-4d03-a672-d8cac34e8dce tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1272 microversion: 2.1 time: 0.097229 Oct 30 00:52:29.936840 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 239/486] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:29 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:30.832587 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c907a3e0-75fe-44ef-8472-c04e77e9e75c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:30.833135 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c907a3e0-75fe-44ef-8472-c04e77e9e75c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:30.839072 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c907a3e0-75fe-44ef-8472-c04e77e9e75c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:30.839554 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c907a3e0-75fe-44ef-8472-c04e77e9e75c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:30.839985 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c907a3e0-75fe-44ef-8472-c04e77e9e75c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:30.840703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c907a3e0-75fe-44ef-8472-c04e77e9e75c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:30.841155 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c907a3e0-75fe-44ef-8472-c04e77e9e75c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:30.841588 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c907a3e0-75fe-44ef-8472-c04e77e9e75c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:30.959241 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-98922040-e243-4f83-8fde-d21a778c330b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:30.959901 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-98922040-e243-4f83-8fde-d21a778c330b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:30.966592 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-98922040-e243-4f83-8fde-d21a778c330b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:30.967081 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-98922040-e243-4f83-8fde-d21a778c330b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:30.967516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-98922040-e243-4f83-8fde-d21a778c330b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:30.969547 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-98922040-e243-4f83-8fde-d21a778c330b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:30.969547 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-98922040-e243-4f83-8fde-d21a778c330b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:30.969547 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-98922040-e243-4f83-8fde-d21a778c330b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:30.991680 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c907a3e0-75fe-44ef-8472-c04e77e9e75c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:31.000336 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c907a3e0-75fe-44ef-8472-c04e77e9e75c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:31.001854 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c907a3e0-75fe-44ef-8472-c04e77e9e75c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:31.003168 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c907a3e0-75fe-44ef-8472-c04e77e9e75c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.174578 Oct 30 00:52:31.016123 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 248/487] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:30 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:31.110145 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-98922040-e243-4f83-8fde-d21a778c330b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:31.119021 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-98922040-e243-4f83-8fde-d21a778c330b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1314 microversion: 2.1 time: 0.163542 Oct 30 00:52:31.119588 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 240/488] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:30 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:52:31.233443 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-89317623-29ac-4633-9d56-cc6cd8d7ae87 req-a022e094-a123-43d3-870b-a607bd9887b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13b8bcf7-ff66-4a87-b856-9b46f05df0fe", "tag": "7a634234-7ce7-449f-ab8f-28461a1b0702"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:52:31.244262 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-89317623-29ac-4633-9d56-cc6cd8d7ae87 req-a022e094-a123-43d3-870b-a607bd9887b7 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:31.244877 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-89317623-29ac-4633-9d56-cc6cd8d7ae87 req-a022e094-a123-43d3-870b-a607bd9887b7 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:31.245453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-89317623-29ac-4633-9d56-cc6cd8d7ae87 req-a022e094-a123-43d3-870b-a607bd9887b7 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:31.257298 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-89317623-29ac-4633-9d56-cc6cd8d7ae87 req-a022e094-a123-43d3-870b-a607bd9887b7 service nova] Creating event network-changed:7a634234-7ce7-449f-ab8f-28461a1b0702 for instance 13b8bcf7-ff66-4a87-b856-9b46f05df0fe on hv-cinder-86149 Oct 30 00:52:31.262295 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-89317623-29ac-4633-9d56-cc6cd8d7ae87 req-a022e094-a123-43d3-870b-a607bd9887b7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032577 Oct 30 00:52:31.262882 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 249/489] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:52:32.015478 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c6992c7a-2f4e-4444-bae9-e86642aa4217 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6517a4c9-353f-4caa-8cef-d4a8117c200d", "device": "/dev/sdb"}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:52:32.019081 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-c6992c7a-2f4e-4444-bae9-e86642aa4217 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:32.025752 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c6992c7a-2f4e-4444-bae9-e86642aa4217 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:32.026233 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c6992c7a-2f4e-4444-bae9-e86642aa4217 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:32.026660 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c6992c7a-2f4e-4444-bae9-e86642aa4217 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:32.027347 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c6992c7a-2f4e-4444-bae9-e86642aa4217 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:32.027791 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c6992c7a-2f4e-4444-bae9-e86642aa4217 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:32.028264 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c6992c7a-2f4e-4444-bae9-e86642aa4217 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:32.029401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4443d61b-0387-4f08-b6ee-de3e5922fba9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:32.030088 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-4443d61b-0387-4f08-b6ee-de3e5922fba9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:32.038895 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4443d61b-0387-4f08-b6ee-de3e5922fba9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:32.039371 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4443d61b-0387-4f08-b6ee-de3e5922fba9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:32.039799 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4443d61b-0387-4f08-b6ee-de3e5922fba9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:32.040514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4443d61b-0387-4f08-b6ee-de3e5922fba9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:32.040960 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4443d61b-0387-4f08-b6ee-de3e5922fba9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:32.041376 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4443d61b-0387-4f08-b6ee-de3e5922fba9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:32.042441 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:32.177507 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4443d61b-0387-4f08-b6ee-de3e5922fba9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:32.185609 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4443d61b-0387-4f08-b6ee-de3e5922fba9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:32.187070 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4443d61b-0387-4f08-b6ee-de3e5922fba9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:32.188246 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-4443d61b-0387-4f08-b6ee-de3e5922fba9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.163129 Oct 30 00:52:32.189414 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 250/490] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:32 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:52:32.194422 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d41c98fe-286f-487c-a49a-15481189c701 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:32.195016 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-d41c98fe-286f-487c-a49a-15481189c701 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:32.200511 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d41c98fe-286f-487c-a49a-15481189c701 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:32.201088 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d41c98fe-286f-487c-a49a-15481189c701 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:32.201519 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d41c98fe-286f-487c-a49a-15481189c701 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:32.202205 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d41c98fe-286f-487c-a49a-15481189c701 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:32.202655 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d41c98fe-286f-487c-a49a-15481189c701 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:32.203075 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d41c98fe-286f-487c-a49a-15481189c701 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:32.336041 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-d41c98fe-286f-487c-a49a-15481189c701 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:32.343607 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-d41c98fe-286f-487c-a49a-15481189c701 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1314 microversion: 2.1 time: 0.152833 Oct 30 00:52:32.344184 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 251/491] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:32 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:33.214999 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-733da6a2-7ad3-4bc2-8ec7-c5a86a1a7f4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:33.215629 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-733da6a2-7ad3-4bc2-8ec7-c5a86a1a7f4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:33.221832 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-733da6a2-7ad3-4bc2-8ec7-c5a86a1a7f4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:33.222311 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-733da6a2-7ad3-4bc2-8ec7-c5a86a1a7f4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:33.222737 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-733da6a2-7ad3-4bc2-8ec7-c5a86a1a7f4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:33.223423 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-733da6a2-7ad3-4bc2-8ec7-c5a86a1a7f4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:33.223872 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-733da6a2-7ad3-4bc2-8ec7-c5a86a1a7f4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:33.224325 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-733da6a2-7ad3-4bc2-8ec7-c5a86a1a7f4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:33.352648 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-733da6a2-7ad3-4bc2-8ec7-c5a86a1a7f4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:33.360618 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-733da6a2-7ad3-4bc2-8ec7-c5a86a1a7f4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:33.362550 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-733da6a2-7ad3-4bc2-8ec7-c5a86a1a7f4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:33.363694 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-733da6a2-7ad3-4bc2-8ec7-c5a86a1a7f4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.152623 Oct 30 00:52:33.364277 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 252/492] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:33 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:52:33.368584 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7a4baf91-8f52-47ff-927e-8f7ccb210eeb tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:33.369178 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-7a4baf91-8f52-47ff-927e-8f7ccb210eeb tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:33.374712 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7a4baf91-8f52-47ff-927e-8f7ccb210eeb tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:33.375185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7a4baf91-8f52-47ff-927e-8f7ccb210eeb tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:33.375613 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7a4baf91-8f52-47ff-927e-8f7ccb210eeb tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:33.376317 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7a4baf91-8f52-47ff-927e-8f7ccb210eeb tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:33.376763 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7a4baf91-8f52-47ff-927e-8f7ccb210eeb tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:33.377182 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7a4baf91-8f52-47ff-927e-8f7ccb210eeb tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:33.508174 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7a4baf91-8f52-47ff-927e-8f7ccb210eeb tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:33.515634 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7a4baf91-8f52-47ff-927e-8f7ccb210eeb tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1314 microversion: 2.1 time: 0.150435 Oct 30 00:52:33.516203 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 253/493] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:33 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:34.389550 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-99193de9-9d06-48c9-bb89-35752aca4dee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:34.390220 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-99193de9-9d06-48c9-bb89-35752aca4dee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:34.396776 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-99193de9-9d06-48c9-bb89-35752aca4dee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:34.397249 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-99193de9-9d06-48c9-bb89-35752aca4dee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:34.397678 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-99193de9-9d06-48c9-bb89-35752aca4dee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:34.398357 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-99193de9-9d06-48c9-bb89-35752aca4dee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:34.398802 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-99193de9-9d06-48c9-bb89-35752aca4dee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:34.399219 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-99193de9-9d06-48c9-bb89-35752aca4dee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:34.532540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-99193de9-9d06-48c9-bb89-35752aca4dee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:34.541099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-99193de9-9d06-48c9-bb89-35752aca4dee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:34.542530 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-99193de9-9d06-48c9-bb89-35752aca4dee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:34.543685 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-99193de9-9d06-48c9-bb89-35752aca4dee tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.158074 Oct 30 00:52:34.544259 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 254/494] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:34 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:52:34.548633 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-587396ab-32c8-41e2-bb6f-3a3c198d5132 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:34.549788 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-587396ab-32c8-41e2-bb6f-3a3c198d5132 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:34.555930 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-587396ab-32c8-41e2-bb6f-3a3c198d5132 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:34.555930 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-587396ab-32c8-41e2-bb6f-3a3c198d5132 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:34.556492 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-587396ab-32c8-41e2-bb6f-3a3c198d5132 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:34.557190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-587396ab-32c8-41e2-bb6f-3a3c198d5132 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:34.557636 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-587396ab-32c8-41e2-bb6f-3a3c198d5132 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:34.558054 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-587396ab-32c8-41e2-bb6f-3a3c198d5132 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:34.686504 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-587396ab-32c8-41e2-bb6f-3a3c198d5132 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:34.694395 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-587396ab-32c8-41e2-bb6f-3a3c198d5132 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1314 microversion: 2.1 time: 0.149193 Oct 30 00:52:34.694953 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 255/495] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:34 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:35.130365 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c6992c7a-2f4e-4444-bae9-e86642aa4217 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "POST /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.118543 Oct 30 00:52:35.132193 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 241/496] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Oct 30 00:52:32 2022] POST /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f/os-volume_attachments => generated 194 bytes in 3121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 00:52:35.570584 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-226cb006-d444-482b-a93d-b490c728b0b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:35.571184 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-226cb006-d444-482b-a93d-b490c728b0b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:35.577091 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-226cb006-d444-482b-a93d-b490c728b0b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:35.577567 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-226cb006-d444-482b-a93d-b490c728b0b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:35.577997 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-226cb006-d444-482b-a93d-b490c728b0b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:35.578678 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-226cb006-d444-482b-a93d-b490c728b0b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:35.579125 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-226cb006-d444-482b-a93d-b490c728b0b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:35.579886 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-226cb006-d444-482b-a93d-b490c728b0b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:35.716974 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-226cb006-d444-482b-a93d-b490c728b0b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:35.719383 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-cf4629d7-f33a-4e00-a910-866bd731318b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:35.721644 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-cf4629d7-f33a-4e00-a910-866bd731318b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:35.725592 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-226cb006-d444-482b-a93d-b490c728b0b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:35.727011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-226cb006-d444-482b-a93d-b490c728b0b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:35.727698 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cf4629d7-f33a-4e00-a910-866bd731318b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:35.728176 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-226cb006-d444-482b-a93d-b490c728b0b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1744 microversion: 2.20 time: 0.161856 Oct 30 00:52:35.728309 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cf4629d7-f33a-4e00-a910-866bd731318b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:35.728685 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cf4629d7-f33a-4e00-a910-866bd731318b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:35.728807 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 256/497] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:35 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:35.729385 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cf4629d7-f33a-4e00-a910-866bd731318b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:35.729897 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cf4629d7-f33a-4e00-a910-866bd731318b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:35.730318 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cf4629d7-f33a-4e00-a910-866bd731318b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:35.867379 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-cf4629d7-f33a-4e00-a910-866bd731318b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:35.875464 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-cf4629d7-f33a-4e00-a910-866bd731318b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1314 microversion: 2.1 time: 0.160513 Oct 30 00:52:35.875814 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 242/498] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:35 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:52:36.755656 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4e815820-e683-4060-87ab-b15f0faf70c6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:36.756273 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-4e815820-e683-4060-87ab-b15f0faf70c6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:36.762190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e815820-e683-4060-87ab-b15f0faf70c6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:36.762664 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e815820-e683-4060-87ab-b15f0faf70c6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:36.763093 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e815820-e683-4060-87ab-b15f0faf70c6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:36.763775 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e815820-e683-4060-87ab-b15f0faf70c6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:36.764248 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e815820-e683-4060-87ab-b15f0faf70c6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:36.764663 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e815820-e683-4060-87ab-b15f0faf70c6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:36.898684 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4e815820-e683-4060-87ab-b15f0faf70c6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:36.899852 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-37059244-cf36-42de-8059-e52579ef8b69 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:36.901519 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-37059244-cf36-42de-8059-e52579ef8b69 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:36.906861 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4e815820-e683-4060-87ab-b15f0faf70c6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:36.908325 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4e815820-e683-4060-87ab-b15f0faf70c6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:36.908938 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-37059244-cf36-42de-8059-e52579ef8b69 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:36.909662 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-37059244-cf36-42de-8059-e52579ef8b69 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:36.910224 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-37059244-cf36-42de-8059-e52579ef8b69 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:36.910339 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-4e815820-e683-4060-87ab-b15f0faf70c6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1744 microversion: 2.20 time: 0.159721 Oct 30 00:52:36.910780 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 257/499] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:36 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:36.911219 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-37059244-cf36-42de-8059-e52579ef8b69 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:36.917118 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-37059244-cf36-42de-8059-e52579ef8b69 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:36.917614 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-37059244-cf36-42de-8059-e52579ef8b69 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:36.936867 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-9c1bbe6a-f7fb-4d3b-99f7-0065ff4e0423 req-ad1615c2-12c9-4fce-998b-c0e10c2c764b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00747eb3-1c2b-40b2-8e0a-9c440529e833", "name": "network-vif-plugged", "status": "completed", "tag": "0b7471a7-8df2-4f56-8dad-8f89610685f3"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:52:36.949678 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-9c1bbe6a-f7fb-4d3b-99f7-0065ff4e0423 req-ad1615c2-12c9-4fce-998b-c0e10c2c764b service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:36.950215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-9c1bbe6a-f7fb-4d3b-99f7-0065ff4e0423 req-ad1615c2-12c9-4fce-998b-c0e10c2c764b service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:36.950630 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-9c1bbe6a-f7fb-4d3b-99f7-0065ff4e0423 req-ad1615c2-12c9-4fce-998b-c0e10c2c764b service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:36.963942 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-9c1bbe6a-f7fb-4d3b-99f7-0065ff4e0423 req-ad1615c2-12c9-4fce-998b-c0e10c2c764b service nova] Creating event network-vif-plugged:0b7471a7-8df2-4f56-8dad-8f89610685f3 for instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 on hv-cinder-86149 Oct 30 00:52:36.969364 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-9c1bbe6a-f7fb-4d3b-99f7-0065ff4e0423 req-ad1615c2-12c9-4fce-998b-c0e10c2c764b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038266 Oct 30 00:52:36.970502 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 258/500] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 00:52:37.060409 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-37059244-cf36-42de-8059-e52579ef8b69 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:37.069086 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-37059244-cf36-42de-8059-e52579ef8b69 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1314 microversion: 2.1 time: 0.173306 Oct 30 00:52:37.069640 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 243/501] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:36 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:37.933201 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=2 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:37.933971 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=6 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:37.938033 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-532d5615-bb8c-4706-9b61-e96d2c7d7761 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:37.938717 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-532d5615-bb8c-4706-9b61-e96d2c7d7761 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:37.945902 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-532d5615-bb8c-4706-9b61-e96d2c7d7761 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:37.946369 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-532d5615-bb8c-4706-9b61-e96d2c7d7761 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:37.946794 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-532d5615-bb8c-4706-9b61-e96d2c7d7761 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:37.947466 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-532d5615-bb8c-4706-9b61-e96d2c7d7761 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:37.947911 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-532d5615-bb8c-4706-9b61-e96d2c7d7761 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:37.948350 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-532d5615-bb8c-4706-9b61-e96d2c7d7761 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:38.079142 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-532d5615-bb8c-4706-9b61-e96d2c7d7761 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:38.087355 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-532d5615-bb8c-4706-9b61-e96d2c7d7761 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:38.088814 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-532d5615-bb8c-4706-9b61-e96d2c7d7761 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:38.089966 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-532d5615-bb8c-4706-9b61-e96d2c7d7761 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1744 microversion: 2.20 time: 0.157730 Oct 30 00:52:38.090509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 259/502] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:37 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:38.092349 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-bb41286e-e9bc-4e2f-ac08-a2cc8d57dd34 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:38.092953 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-bb41286e-e9bc-4e2f-ac08-a2cc8d57dd34 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:38.095353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=2 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:38.101157 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bb41286e-e9bc-4e2f-ac08-a2cc8d57dd34 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:38.101630 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bb41286e-e9bc-4e2f-ac08-a2cc8d57dd34 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:38.102057 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bb41286e-e9bc-4e2f-ac08-a2cc8d57dd34 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:38.102739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bb41286e-e9bc-4e2f-ac08-a2cc8d57dd34 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:38.103184 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bb41286e-e9bc-4e2f-ac08-a2cc8d57dd34 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:38.103598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bb41286e-e9bc-4e2f-ac08-a2cc8d57dd34 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:38.234221 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-bb41286e-e9bc-4e2f-ac08-a2cc8d57dd34 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:38.242582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-bb41286e-e9bc-4e2f-ac08-a2cc8d57dd34 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1314 microversion: 2.1 time: 0.153988 Oct 30 00:52:38.243133 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 244/503] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:38 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:52:38.829695 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-733af28d-bcb1-4613-b835-eb32ec81b4a6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:38.830263 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-733af28d-bcb1-4613-b835-eb32ec81b4a6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:38.837223 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-733af28d-bcb1-4613-b835-eb32ec81b4a6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:38.837710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-733af28d-bcb1-4613-b835-eb32ec81b4a6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:38.838138 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-733af28d-bcb1-4613-b835-eb32ec81b4a6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:38.838828 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-733af28d-bcb1-4613-b835-eb32ec81b4a6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:38.839278 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-733af28d-bcb1-4613-b835-eb32ec81b4a6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:38.839695 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-733af28d-bcb1-4613-b835-eb32ec81b4a6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:38.862830 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-733af28d-bcb1-4613-b835-eb32ec81b4a6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26/ips" status: 200 len: 145 microversion: 2.1 time: 0.036929 Oct 30 00:52:38.863400 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 260/504] 10.222.0.36 () {58 vars in 1248 bytes} [Sun Oct 30 00:52:38 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:52:38.991946 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-c567b464-b7fd-4d83-83f9-cc44511e5279 req-c65c5791-37a9-4814-808f-0ddec4bd2474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b8bcf7-ff66-4a87-b856-9b46f05df0fe", "name": "network-vif-plugged", "status": "completed", "tag": "7a634234-7ce7-449f-ab8f-28461a1b0702"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:52:39.001550 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-c567b464-b7fd-4d83-83f9-cc44511e5279 req-c65c5791-37a9-4814-808f-0ddec4bd2474 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:39.002022 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-c567b464-b7fd-4d83-83f9-cc44511e5279 req-c65c5791-37a9-4814-808f-0ddec4bd2474 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:39.003070 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-c567b464-b7fd-4d83-83f9-cc44511e5279 req-c65c5791-37a9-4814-808f-0ddec4bd2474 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:39.014030 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-c567b464-b7fd-4d83-83f9-cc44511e5279 req-c65c5791-37a9-4814-808f-0ddec4bd2474 service nova] Creating event network-vif-plugged:7a634234-7ce7-449f-ab8f-28461a1b0702 for instance 13b8bcf7-ff66-4a87-b856-9b46f05df0fe on hv-cinder-86149 Oct 30 00:52:39.019003 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-c567b464-b7fd-4d83-83f9-cc44511e5279 req-c65c5791-37a9-4814-808f-0ddec4bd2474 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030550 Oct 30 00:52:39.019660 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 245/505] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:52:39.116818 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4ce0ac8b-9250-44af-a6bc-75d2e3858dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:39.117420 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-4ce0ac8b-9250-44af-a6bc-75d2e3858dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:39.123426 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4ce0ac8b-9250-44af-a6bc-75d2e3858dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:39.123908 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4ce0ac8b-9250-44af-a6bc-75d2e3858dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:39.124359 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4ce0ac8b-9250-44af-a6bc-75d2e3858dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:39.125129 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4ce0ac8b-9250-44af-a6bc-75d2e3858dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:39.125555 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4ce0ac8b-9250-44af-a6bc-75d2e3858dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:39.125931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4ce0ac8b-9250-44af-a6bc-75d2e3858dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:39.130745 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=100 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:39.264942 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4ce0ac8b-9250-44af-a6bc-75d2e3858dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:39.265572 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5aaa8d8e-d31e-4ea1-80d3-d3c8474dd85b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:39.266956 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5aaa8d8e-d31e-4ea1-80d3-d3c8474dd85b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:39.273471 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4ce0ac8b-9250-44af-a6bc-75d2e3858dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:39.273827 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5aaa8d8e-d31e-4ea1-80d3-d3c8474dd85b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:39.274318 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5aaa8d8e-d31e-4ea1-80d3-d3c8474dd85b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:39.274756 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5aaa8d8e-d31e-4ea1-80d3-d3c8474dd85b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:39.275461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5aaa8d8e-d31e-4ea1-80d3-d3c8474dd85b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:39.275853 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4ce0ac8b-9250-44af-a6bc-75d2e3858dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:39.275977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5aaa8d8e-d31e-4ea1-80d3-d3c8474dd85b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:39.276350 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5aaa8d8e-d31e-4ea1-80d3-d3c8474dd85b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:39.277707 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-4ce0ac8b-9250-44af-a6bc-75d2e3858dff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1744 microversion: 2.20 time: 0.164814 Oct 30 00:52:39.278331 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 261/506] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:39 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:39.415852 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5aaa8d8e-d31e-4ea1-80d3-d3c8474dd85b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:39.423602 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5aaa8d8e-d31e-4ea1-80d3-d3c8474dd85b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1314 microversion: 2.1 time: 0.162135 Oct 30 00:52:39.424172 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 246/507] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:39 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:52:40.303350 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b4f5e971-1afa-4b7b-a827-c28c442b9314 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:40.303953 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-b4f5e971-1afa-4b7b-a827-c28c442b9314 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:40.309960 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b4f5e971-1afa-4b7b-a827-c28c442b9314 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:40.310451 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b4f5e971-1afa-4b7b-a827-c28c442b9314 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:40.310861 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b4f5e971-1afa-4b7b-a827-c28c442b9314 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:40.311538 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b4f5e971-1afa-4b7b-a827-c28c442b9314 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:40.311984 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b4f5e971-1afa-4b7b-a827-c28c442b9314 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:40.312426 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b4f5e971-1afa-4b7b-a827-c28c442b9314 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:40.439696 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b4f5e971-1afa-4b7b-a827-c28c442b9314 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:40.447355 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d654531c-9147-4d16-bb61-3cfd3daa7cf9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:40.448245 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d654531c-9147-4d16-bb61-3cfd3daa7cf9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:40.448953 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b4f5e971-1afa-4b7b-a827-c28c442b9314 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:40.450390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b4f5e971-1afa-4b7b-a827-c28c442b9314 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:40.451540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b4f5e971-1afa-4b7b-a827-c28c442b9314 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1744 microversion: 2.20 time: 0.152729 Oct 30 00:52:40.452450 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 262/508] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:40 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:40.455429 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d654531c-9147-4d16-bb61-3cfd3daa7cf9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:40.456759 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d654531c-9147-4d16-bb61-3cfd3daa7cf9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:40.457444 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d654531c-9147-4d16-bb61-3cfd3daa7cf9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:40.458236 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d654531c-9147-4d16-bb61-3cfd3daa7cf9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:40.458745 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d654531c-9147-4d16-bb61-3cfd3daa7cf9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:40.459324 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d654531c-9147-4d16-bb61-3cfd3daa7cf9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:40.586812 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d654531c-9147-4d16-bb61-3cfd3daa7cf9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:40.594402 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d654531c-9147-4d16-bb61-3cfd3daa7cf9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1314 microversion: 2.1 time: 0.151169 Oct 30 00:52:40.594958 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 247/509] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:40 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:52:41.478044 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-50f912a0-272d-4174-81c8-cb82731ad82d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:41.478707 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-50f912a0-272d-4174-81c8-cb82731ad82d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:41.485100 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50f912a0-272d-4174-81c8-cb82731ad82d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:41.485572 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50f912a0-272d-4174-81c8-cb82731ad82d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:41.485994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50f912a0-272d-4174-81c8-cb82731ad82d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:41.486665 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50f912a0-272d-4174-81c8-cb82731ad82d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:41.487249 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50f912a0-272d-4174-81c8-cb82731ad82d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:41.487811 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-50f912a0-272d-4174-81c8-cb82731ad82d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:41.617922 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-048ff689-3d69-4365-8d80-f0ad89a8a119 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:41.618562 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-048ff689-3d69-4365-8d80-f0ad89a8a119 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:41.621870 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-50f912a0-272d-4174-81c8-cb82731ad82d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:41.625162 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-048ff689-3d69-4365-8d80-f0ad89a8a119 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:41.625648 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-048ff689-3d69-4365-8d80-f0ad89a8a119 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:41.626081 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-048ff689-3d69-4365-8d80-f0ad89a8a119 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:41.626775 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-048ff689-3d69-4365-8d80-f0ad89a8a119 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:41.627224 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-048ff689-3d69-4365-8d80-f0ad89a8a119 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:41.627708 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-048ff689-3d69-4365-8d80-f0ad89a8a119 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:41.629919 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-50f912a0-272d-4174-81c8-cb82731ad82d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:41.631334 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-50f912a0-272d-4174-81c8-cb82731ad82d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:41.632503 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-50f912a0-272d-4174-81c8-cb82731ad82d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1744 microversion: 2.20 time: 0.158482 Oct 30 00:52:41.633046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 263/510] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:41 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:41.757644 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-048ff689-3d69-4365-8d80-f0ad89a8a119 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:41.765228 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-048ff689-3d69-4365-8d80-f0ad89a8a119 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1314 microversion: 2.1 time: 0.151115 Oct 30 00:52:41.765810 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 248/511] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:41 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:52:42.041003 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4a2c2b8f-9282-4476-b8cf-db73e018e44d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10252a4f-a238-4788-9413-0a83986893c4"}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:52:42.043307 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-4a2c2b8f-9282-4476-b8cf-db73e018e44d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:42.049164 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4a2c2b8f-9282-4476-b8cf-db73e018e44d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:42.049687 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4a2c2b8f-9282-4476-b8cf-db73e018e44d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:42.050119 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4a2c2b8f-9282-4476-b8cf-db73e018e44d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:42.050791 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4a2c2b8f-9282-4476-b8cf-db73e018e44d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:42.051235 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4a2c2b8f-9282-4476-b8cf-db73e018e44d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:42.051649 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4a2c2b8f-9282-4476-b8cf-db73e018e44d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:42.658000 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-2debde35-c899-449a-b3da-f3beeba9cd4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:42.658598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-2debde35-c899-449a-b3da-f3beeba9cd4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:42.665948 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2debde35-c899-449a-b3da-f3beeba9cd4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:42.666423 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2debde35-c899-449a-b3da-f3beeba9cd4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:42.666849 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2debde35-c899-449a-b3da-f3beeba9cd4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:42.667528 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2debde35-c899-449a-b3da-f3beeba9cd4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:42.667973 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2debde35-c899-449a-b3da-f3beeba9cd4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:42.668412 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2debde35-c899-449a-b3da-f3beeba9cd4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:42.805179 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-2debde35-c899-449a-b3da-f3beeba9cd4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:42.813735 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-2debde35-c899-449a-b3da-f3beeba9cd4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:42.816223 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-2debde35-c899-449a-b3da-f3beeba9cd4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:42.817888 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-2debde35-c899-449a-b3da-f3beeba9cd4b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1744 microversion: 2.20 time: 0.163766 Oct 30 00:52:42.818447 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 249/512] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:42 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:52:42.842213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-b6ded11a-a072-4bb9-b766-28a8c007f83b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:42.842827 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-b6ded11a-a072-4bb9-b766-28a8c007f83b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:42.849543 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b6ded11a-a072-4bb9-b766-28a8c007f83b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:42.850022 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b6ded11a-a072-4bb9-b766-28a8c007f83b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:42.850450 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b6ded11a-a072-4bb9-b766-28a8c007f83b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:42.851136 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b6ded11a-a072-4bb9-b766-28a8c007f83b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:42.851581 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b6ded11a-a072-4bb9-b766-28a8c007f83b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:42.852027 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b6ded11a-a072-4bb9-b766-28a8c007f83b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:42.985077 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-b6ded11a-a072-4bb9-b766-28a8c007f83b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:42.993184 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-b6ded11a-a072-4bb9-b766-28a8c007f83b tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1497 microversion: 2.1 time: 0.164074 Oct 30 00:52:42.993731 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 250/513] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:42 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:43.297895 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-4a2c2b8f-9282-4476-b8cf-db73e018e44d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "POST /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.260174 Oct 30 00:52:43.298982 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 264/514] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Oct 30 00:52:42 2022] POST /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26/os-volume_attachments => generated 194 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:52:43.623691 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-ede06d0a-7b97-4c8b-8368-6e48db4554b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:43.624221 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-ede06d0a-7b97-4c8b-8368-6e48db4554b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:43.630951 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ede06d0a-7b97-4c8b-8368-6e48db4554b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:43.631468 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ede06d0a-7b97-4c8b-8368-6e48db4554b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:43.631904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ede06d0a-7b97-4c8b-8368-6e48db4554b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:43.632655 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ede06d0a-7b97-4c8b-8368-6e48db4554b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:43.633571 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ede06d0a-7b97-4c8b-8368-6e48db4554b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:43.633571 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ede06d0a-7b97-4c8b-8368-6e48db4554b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:43.660775 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-ede06d0a-7b97-4c8b-8368-6e48db4554b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Going to try to terminate instance {{(pid=125553) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 00:52:43.749006 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-ede06d0a-7b97-4c8b-8368-6e48db4554b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "DELETE /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 204 len: 0 microversion: 2.1 time: 0.128581 Oct 30 00:52:43.749702 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 251/515] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 00:52:43 2022] DELETE /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 00:52:43.764415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-883ddcba-b7c5-4d30-a6c9-0bc1eeb45bd9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:43.765102 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-883ddcba-b7c5-4d30-a6c9-0bc1eeb45bd9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:43.767059 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:43.773426 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-883ddcba-b7c5-4d30-a6c9-0bc1eeb45bd9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:43.773840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-883ddcba-b7c5-4d30-a6c9-0bc1eeb45bd9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:43.774262 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-883ddcba-b7c5-4d30-a6c9-0bc1eeb45bd9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:43.775141 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-883ddcba-b7c5-4d30-a6c9-0bc1eeb45bd9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:43.775585 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-883ddcba-b7c5-4d30-a6c9-0bc1eeb45bd9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:43.775996 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-883ddcba-b7c5-4d30-a6c9-0bc1eeb45bd9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:43.850775 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c8379cd4-40d9-4fab-84c1-ffb718e33724 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:43.851539 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-c8379cd4-40d9-4fab-84c1-ffb718e33724 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:43.861653 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c8379cd4-40d9-4fab-84c1-ffb718e33724 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:43.864178 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c8379cd4-40d9-4fab-84c1-ffb718e33724 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:43.867028 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c8379cd4-40d9-4fab-84c1-ffb718e33724 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:43.870134 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c8379cd4-40d9-4fab-84c1-ffb718e33724 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:43.872188 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c8379cd4-40d9-4fab-84c1-ffb718e33724 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:43.874003 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c8379cd4-40d9-4fab-84c1-ffb718e33724 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:44.051752 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-883ddcba-b7c5-4d30-a6c9-0bc1eeb45bd9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:44.067340 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-883ddcba-b7c5-4d30-a6c9-0bc1eeb45bd9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1503 microversion: 2.1 time: 0.307147 Oct 30 00:52:44.067924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 265/516] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:43 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1503 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:44.131809 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c8379cd4-40d9-4fab-84c1-ffb718e33724 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:44.142706 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c8379cd4-40d9-4fab-84c1-ffb718e33724 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:44.146444 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c8379cd4-40d9-4fab-84c1-ffb718e33724 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:44.148109 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c8379cd4-40d9-4fab-84c1-ffb718e33724 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1739 microversion: 2.20 time: 0.302244 Oct 30 00:52:44.149215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 252/517] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:43 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1739 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:52:45.094151 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-47d1f2bb-3f46-4e84-b0f2-5cb7d7de932f tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:45.094915 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-47d1f2bb-3f46-4e84-b0f2-5cb7d7de932f tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:45.102287 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-47d1f2bb-3f46-4e84-b0f2-5cb7d7de932f tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:45.103075 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-47d1f2bb-3f46-4e84-b0f2-5cb7d7de932f tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:45.103581 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-47d1f2bb-3f46-4e84-b0f2-5cb7d7de932f tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:45.104577 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-47d1f2bb-3f46-4e84-b0f2-5cb7d7de932f tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:45.105127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-47d1f2bb-3f46-4e84-b0f2-5cb7d7de932f tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:45.105618 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-47d1f2bb-3f46-4e84-b0f2-5cb7d7de932f tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:45.181863 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-77ea2f3e-43b9-4854-8822-8ef72ae95e07 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:45.183099 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-77ea2f3e-43b9-4854-8822-8ef72ae95e07 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:45.192872 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-77ea2f3e-43b9-4854-8822-8ef72ae95e07 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:45.193378 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-77ea2f3e-43b9-4854-8822-8ef72ae95e07 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:45.196614 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-77ea2f3e-43b9-4854-8822-8ef72ae95e07 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:45.198464 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-77ea2f3e-43b9-4854-8822-8ef72ae95e07 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:45.199124 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-77ea2f3e-43b9-4854-8822-8ef72ae95e07 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:45.199705 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-77ea2f3e-43b9-4854-8822-8ef72ae95e07 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:45.329516 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-47d1f2bb-3f46-4e84-b0f2-5cb7d7de932f tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:45.340339 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-47d1f2bb-3f46-4e84-b0f2-5cb7d7de932f tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1503 microversion: 2.1 time: 0.250037 Oct 30 00:52:45.352564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 266/518] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:45 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1503 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:45.379242 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-77ea2f3e-43b9-4854-8822-8ef72ae95e07 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:45.388703 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-77ea2f3e-43b9-4854-8822-8ef72ae95e07 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:45.390417 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-77ea2f3e-43b9-4854-8822-8ef72ae95e07 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:45.391573 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-77ea2f3e-43b9-4854-8822-8ef72ae95e07 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1739 microversion: 2.20 time: 0.213727 Oct 30 00:52:45.392170 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 253/519] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:45 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:46.366341 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2558cada-b2ae-4bd6-878d-3d0898981482 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:46.367146 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2558cada-b2ae-4bd6-878d-3d0898981482 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:46.373648 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2558cada-b2ae-4bd6-878d-3d0898981482 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:46.374115 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2558cada-b2ae-4bd6-878d-3d0898981482 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:46.374754 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2558cada-b2ae-4bd6-878d-3d0898981482 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:46.375607 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2558cada-b2ae-4bd6-878d-3d0898981482 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:46.376395 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2558cada-b2ae-4bd6-878d-3d0898981482 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:46.377005 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2558cada-b2ae-4bd6-878d-3d0898981482 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:46.421692 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-15c52bbc-0d26-466c-b04f-44b74b628fdb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:46.422947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-15c52bbc-0d26-466c-b04f-44b74b628fdb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:46.429098 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-15c52bbc-0d26-466c-b04f-44b74b628fdb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:46.429933 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-15c52bbc-0d26-466c-b04f-44b74b628fdb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:46.430574 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-15c52bbc-0d26-466c-b04f-44b74b628fdb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:46.431581 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-15c52bbc-0d26-466c-b04f-44b74b628fdb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:46.432349 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-15c52bbc-0d26-466c-b04f-44b74b628fdb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:46.432997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-15c52bbc-0d26-466c-b04f-44b74b628fdb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:46.607762 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2558cada-b2ae-4bd6-878d-3d0898981482 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:46.616959 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2558cada-b2ae-4bd6-878d-3d0898981482 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1503 microversion: 2.1 time: 0.255140 Oct 30 00:52:46.623019 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 267/520] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:46 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1503 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:46.636693 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-15c52bbc-0d26-466c-b04f-44b74b628fdb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:46.646183 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-15c52bbc-0d26-466c-b04f-44b74b628fdb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:46.647614 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-15c52bbc-0d26-466c-b04f-44b74b628fdb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:46.652345 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-15c52bbc-0d26-466c-b04f-44b74b628fdb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1739 microversion: 2.20 time: 0.231702 Oct 30 00:52:46.664690 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 254/521] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:46 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1739 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:52:47.642785 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-1bed5e95-3cad-4495-af4f-ff175038fad4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:47.644199 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-1bed5e95-3cad-4495-af4f-ff175038fad4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:47.652971 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1bed5e95-3cad-4495-af4f-ff175038fad4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:47.658014 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1bed5e95-3cad-4495-af4f-ff175038fad4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:47.660216 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1bed5e95-3cad-4495-af4f-ff175038fad4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:47.661396 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1bed5e95-3cad-4495-af4f-ff175038fad4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:47.662307 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1bed5e95-3cad-4495-af4f-ff175038fad4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:47.662960 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1bed5e95-3cad-4495-af4f-ff175038fad4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:47.684939 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-bbac446d-9e5a-4b78-914b-498b5eef5fc9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:47.686929 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-bbac446d-9e5a-4b78-914b-498b5eef5fc9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:47.695707 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bbac446d-9e5a-4b78-914b-498b5eef5fc9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:47.696368 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bbac446d-9e5a-4b78-914b-498b5eef5fc9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:47.696902 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bbac446d-9e5a-4b78-914b-498b5eef5fc9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:47.697863 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bbac446d-9e5a-4b78-914b-498b5eef5fc9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:47.698675 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bbac446d-9e5a-4b78-914b-498b5eef5fc9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:47.699333 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bbac446d-9e5a-4b78-914b-498b5eef5fc9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:47.861395 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-1bed5e95-3cad-4495-af4f-ff175038fad4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:47.870960 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-1bed5e95-3cad-4495-af4f-ff175038fad4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1503 microversion: 2.1 time: 0.233283 Oct 30 00:52:47.872172 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 268/522] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:47 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1503 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:47.919162 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-bbac446d-9e5a-4b78-914b-498b5eef5fc9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:47.923071 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:47.935407 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-bbac446d-9e5a-4b78-914b-498b5eef5fc9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:47.937249 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-bbac446d-9e5a-4b78-914b-498b5eef5fc9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:47.938500 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-bbac446d-9e5a-4b78-914b-498b5eef5fc9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1739 microversion: 2.20 time: 0.265571 Oct 30 00:52:47.939121 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 255/523] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:47 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1739 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:48.899218 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-26142446-b75c-47fd-8b30-cc194d4f8c4a tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:48.900958 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-26142446-b75c-47fd-8b30-cc194d4f8c4a tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:48.907758 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-26142446-b75c-47fd-8b30-cc194d4f8c4a tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:48.908696 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-26142446-b75c-47fd-8b30-cc194d4f8c4a tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:48.910096 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-26142446-b75c-47fd-8b30-cc194d4f8c4a tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:48.910937 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-26142446-b75c-47fd-8b30-cc194d4f8c4a tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:48.911645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-26142446-b75c-47fd-8b30-cc194d4f8c4a tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:48.912410 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-26142446-b75c-47fd-8b30-cc194d4f8c4a tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:48.965982 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-32e0ed64-bc86-4489-bf8a-6d2f8ae09580 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:48.966633 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-32e0ed64-bc86-4489-bf8a-6d2f8ae09580 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:48.974645 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-32e0ed64-bc86-4489-bf8a-6d2f8ae09580 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:48.975393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-32e0ed64-bc86-4489-bf8a-6d2f8ae09580 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:48.976005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-32e0ed64-bc86-4489-bf8a-6d2f8ae09580 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:48.976758 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-32e0ed64-bc86-4489-bf8a-6d2f8ae09580 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:48.977241 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-32e0ed64-bc86-4489-bf8a-6d2f8ae09580 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:48.977633 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-32e0ed64-bc86-4489-bf8a-6d2f8ae09580 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:49.133868 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-26142446-b75c-47fd-8b30-cc194d4f8c4a tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:49.155575 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-26142446-b75c-47fd-8b30-cc194d4f8c4a tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1503 microversion: 2.1 time: 0.260348 Oct 30 00:52:49.158754 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 269/524] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:48 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1503 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:49.196656 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-32e0ed64-bc86-4489-bf8a-6d2f8ae09580 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:49.217516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-32e0ed64-bc86-4489-bf8a-6d2f8ae09580 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:49.219176 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-32e0ed64-bc86-4489-bf8a-6d2f8ae09580 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:49.220580 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-32e0ed64-bc86-4489-bf8a-6d2f8ae09580 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1739 microversion: 2.20 time: 0.259001 Oct 30 00:52:49.236117 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 256/525] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:48 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1739 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:52:50.188584 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-58e4fe4b-aa72-4afb-a4da-79ab6af9a351 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:50.189883 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-58e4fe4b-aa72-4afb-a4da-79ab6af9a351 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:50.199065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58e4fe4b-aa72-4afb-a4da-79ab6af9a351 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:50.199983 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58e4fe4b-aa72-4afb-a4da-79ab6af9a351 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:50.200446 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58e4fe4b-aa72-4afb-a4da-79ab6af9a351 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:50.201150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58e4fe4b-aa72-4afb-a4da-79ab6af9a351 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:50.201949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58e4fe4b-aa72-4afb-a4da-79ab6af9a351 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:50.202601 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58e4fe4b-aa72-4afb-a4da-79ab6af9a351 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:50.246872 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c37133b6-d9e8-4b43-b0f1-29da6811dcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:50.247509 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-c37133b6-d9e8-4b43-b0f1-29da6811dcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:50.264159 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c37133b6-d9e8-4b43-b0f1-29da6811dcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:50.270029 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c37133b6-d9e8-4b43-b0f1-29da6811dcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:50.270638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c37133b6-d9e8-4b43-b0f1-29da6811dcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:50.275098 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c37133b6-d9e8-4b43-b0f1-29da6811dcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:50.277303 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c37133b6-d9e8-4b43-b0f1-29da6811dcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:50.277831 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c37133b6-d9e8-4b43-b0f1-29da6811dcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:50.313526 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-58e4fe4b-aa72-4afb-a4da-79ab6af9a351 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:50.323101 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-58e4fe4b-aa72-4afb-a4da-79ab6af9a351 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1461 microversion: 2.1 time: 0.138952 Oct 30 00:52:50.326520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 270/526] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:50 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1461 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:50.358827 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-40290652-85d6-43e9-967e-54adcdee08d3 req-503c78ad-1c2e-4e33-b5d0-fd7dc7b0c065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b8bcf7-ff66-4a87-b856-9b46f05df0fe", "name": "network-vif-deleted", "tag": "7a634234-7ce7-449f-ab8f-28461a1b0702"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:52:50.369826 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-40290652-85d6-43e9-967e-54adcdee08d3 req-503c78ad-1c2e-4e33-b5d0-fd7dc7b0c065 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:50.369826 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-40290652-85d6-43e9-967e-54adcdee08d3 req-503c78ad-1c2e-4e33-b5d0-fd7dc7b0c065 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:50.370101 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-40290652-85d6-43e9-967e-54adcdee08d3 req-503c78ad-1c2e-4e33-b5d0-fd7dc7b0c065 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:50.387535 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-40290652-85d6-43e9-967e-54adcdee08d3 req-503c78ad-1c2e-4e33-b5d0-fd7dc7b0c065 service nova] Creating event network-vif-deleted:7a634234-7ce7-449f-ab8f-28461a1b0702 for instance 13b8bcf7-ff66-4a87-b856-9b46f05df0fe on hv-cinder-86149 Oct 30 00:52:50.393226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-40290652-85d6-43e9-967e-54adcdee08d3 req-503c78ad-1c2e-4e33-b5d0-fd7dc7b0c065 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038139 Oct 30 00:52:50.394533 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 271/527] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:52:50.469792 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c37133b6-d9e8-4b43-b0f1-29da6811dcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:50.490271 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c37133b6-d9e8-4b43-b0f1-29da6811dcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:50.491706 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c37133b6-d9e8-4b43-b0f1-29da6811dcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:50.492898 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c37133b6-d9e8-4b43-b0f1-29da6811dcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1739 microversion: 2.20 time: 0.250115 Oct 30 00:52:50.498079 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 257/528] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:50 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:52:51.351210 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-e924ce13-304c-41d9-81d4-2c72a18a7805 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:51.352055 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-e924ce13-304c-41d9-81d4-2c72a18a7805 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:51.359403 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e924ce13-304c-41d9-81d4-2c72a18a7805 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:51.359875 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e924ce13-304c-41d9-81d4-2c72a18a7805 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:51.360574 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e924ce13-304c-41d9-81d4-2c72a18a7805 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:51.361533 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e924ce13-304c-41d9-81d4-2c72a18a7805 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:51.362314 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e924ce13-304c-41d9-81d4-2c72a18a7805 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:51.362931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e924ce13-304c-41d9-81d4-2c72a18a7805 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:51.438385 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e924ce13-304c-41d9-81d4-2c72a18a7805 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:51.447405 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-e924ce13-304c-41d9-81d4-2c72a18a7805 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1461 microversion: 2.1 time: 0.100982 Oct 30 00:52:51.447979 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 272/529] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:51 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1461 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:51.525034 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3c2636b9-d85d-4dbb-8b1c-e234815a53bb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:51.526674 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-3c2636b9-d85d-4dbb-8b1c-e234815a53bb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:51.531354 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:51.536571 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3c2636b9-d85d-4dbb-8b1c-e234815a53bb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:51.537224 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3c2636b9-d85d-4dbb-8b1c-e234815a53bb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:51.538030 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3c2636b9-d85d-4dbb-8b1c-e234815a53bb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:51.539050 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3c2636b9-d85d-4dbb-8b1c-e234815a53bb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:51.545838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3c2636b9-d85d-4dbb-8b1c-e234815a53bb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:51.546424 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3c2636b9-d85d-4dbb-8b1c-e234815a53bb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:51.702430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3c2636b9-d85d-4dbb-8b1c-e234815a53bb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:51.712574 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3c2636b9-d85d-4dbb-8b1c-e234815a53bb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:51.714020 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3c2636b9-d85d-4dbb-8b1c-e234815a53bb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:51.715401 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-3c2636b9-d85d-4dbb-8b1c-e234815a53bb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1739 microversion: 2.20 time: 0.195602 Oct 30 00:52:51.716449 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 258/530] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:51 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:52.473409 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-e24bf22c-efaf-4fb2-8e20-56b9fd4bb6e7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:52.474015 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-e24bf22c-efaf-4fb2-8e20-56b9fd4bb6e7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:52.481248 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e24bf22c-efaf-4fb2-8e20-56b9fd4bb6e7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:52.481763 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e24bf22c-efaf-4fb2-8e20-56b9fd4bb6e7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:52.482163 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e24bf22c-efaf-4fb2-8e20-56b9fd4bb6e7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:52.482858 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e24bf22c-efaf-4fb2-8e20-56b9fd4bb6e7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:52.483303 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e24bf22c-efaf-4fb2-8e20-56b9fd4bb6e7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:52.483722 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e24bf22c-efaf-4fb2-8e20-56b9fd4bb6e7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:52.560975 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e24bf22c-efaf-4fb2-8e20-56b9fd4bb6e7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:52.576738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-e24bf22c-efaf-4fb2-8e20-56b9fd4bb6e7 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1461 microversion: 2.1 time: 0.102940 Oct 30 00:52:52.576738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 273/531] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:52 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1461 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:52.745203 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-62d4e6d8-8f6d-4519-bd51-6ab038a24e03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:52.745800 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-62d4e6d8-8f6d-4519-bd51-6ab038a24e03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:52.754694 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-62d4e6d8-8f6d-4519-bd51-6ab038a24e03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:52.757657 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-62d4e6d8-8f6d-4519-bd51-6ab038a24e03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:52.758335 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-62d4e6d8-8f6d-4519-bd51-6ab038a24e03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:52.760049 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-62d4e6d8-8f6d-4519-bd51-6ab038a24e03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:52.761436 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-62d4e6d8-8f6d-4519-bd51-6ab038a24e03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:52.761888 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-62d4e6d8-8f6d-4519-bd51-6ab038a24e03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:52.928957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-62d4e6d8-8f6d-4519-bd51-6ab038a24e03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:52.937553 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-62d4e6d8-8f6d-4519-bd51-6ab038a24e03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:52.939447 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-62d4e6d8-8f6d-4519-bd51-6ab038a24e03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:52.940947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-62d4e6d8-8f6d-4519-bd51-6ab038a24e03 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1739 microversion: 2.20 time: 0.200184 Oct 30 00:52:52.941758 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 259/532] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:52 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:53.595029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ddfab4cb-ae70-4cfd-9a22-c3f9c7939e75 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:53.595631 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ddfab4cb-ae70-4cfd-9a22-c3f9c7939e75 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:53.602987 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ddfab4cb-ae70-4cfd-9a22-c3f9c7939e75 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:53.603548 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ddfab4cb-ae70-4cfd-9a22-c3f9c7939e75 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:53.603874 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ddfab4cb-ae70-4cfd-9a22-c3f9c7939e75 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:53.604801 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ddfab4cb-ae70-4cfd-9a22-c3f9c7939e75 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:53.605254 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ddfab4cb-ae70-4cfd-9a22-c3f9c7939e75 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:53.605739 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ddfab4cb-ae70-4cfd-9a22-c3f9c7939e75 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:53.673370 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ddfab4cb-ae70-4cfd-9a22-c3f9c7939e75 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:53.682046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ddfab4cb-ae70-4cfd-9a22-c3f9c7939e75 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1461 microversion: 2.1 time: 0.091101 Oct 30 00:52:53.682603 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 274/533] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:53 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1461 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:53.969417 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d869bf49-eeb7-431c-a8c8-3c81e72f09ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:53.970013 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d869bf49-eeb7-431c-a8c8-3c81e72f09ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:53.976995 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d869bf49-eeb7-431c-a8c8-3c81e72f09ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:53.977470 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d869bf49-eeb7-431c-a8c8-3c81e72f09ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:53.977897 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d869bf49-eeb7-431c-a8c8-3c81e72f09ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:53.978584 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d869bf49-eeb7-431c-a8c8-3c81e72f09ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:53.979030 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d869bf49-eeb7-431c-a8c8-3c81e72f09ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:53.979475 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d869bf49-eeb7-431c-a8c8-3c81e72f09ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:54.110362 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d869bf49-eeb7-431c-a8c8-3c81e72f09ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:54.118448 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d869bf49-eeb7-431c-a8c8-3c81e72f09ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:54.119879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d869bf49-eeb7-431c-a8c8-3c81e72f09ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:54.121045 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d869bf49-eeb7-431c-a8c8-3c81e72f09ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1739 microversion: 2.20 time: 0.155472 Oct 30 00:52:54.121594 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 260/534] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:53 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:52:54.704950 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-a4abaaa7-63ad-440e-be16-39c3dc70d0d4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:54.705559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-a4abaaa7-63ad-440e-be16-39c3dc70d0d4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:54.712719 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a4abaaa7-63ad-440e-be16-39c3dc70d0d4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:54.713196 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a4abaaa7-63ad-440e-be16-39c3dc70d0d4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:54.713626 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a4abaaa7-63ad-440e-be16-39c3dc70d0d4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:54.714312 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a4abaaa7-63ad-440e-be16-39c3dc70d0d4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:54.714762 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a4abaaa7-63ad-440e-be16-39c3dc70d0d4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:54.715182 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a4abaaa7-63ad-440e-be16-39c3dc70d0d4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:54.776640 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-a4abaaa7-63ad-440e-be16-39c3dc70d0d4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:54.784487 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-a4abaaa7-63ad-440e-be16-39c3dc70d0d4 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1299 microversion: 2.1 time: 0.083210 Oct 30 00:52:54.785194 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 275/535] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:54 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:55.147460 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d9fa8faf-a864-418c-8173-c1e5ef644a52 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:55.148213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d9fa8faf-a864-418c-8173-c1e5ef644a52 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:55.154524 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d9fa8faf-a864-418c-8173-c1e5ef644a52 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:55.155077 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d9fa8faf-a864-418c-8173-c1e5ef644a52 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:55.155572 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d9fa8faf-a864-418c-8173-c1e5ef644a52 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:55.156361 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d9fa8faf-a864-418c-8173-c1e5ef644a52 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:55.156879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d9fa8faf-a864-418c-8173-c1e5ef644a52 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:55.157411 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d9fa8faf-a864-418c-8173-c1e5ef644a52 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:55.307601 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d9fa8faf-a864-418c-8173-c1e5ef644a52 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:55.315666 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d9fa8faf-a864-418c-8173-c1e5ef644a52 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:55.317292 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d9fa8faf-a864-418c-8173-c1e5ef644a52 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:55.318437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d9fa8faf-a864-418c-8173-c1e5ef644a52 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1739 microversion: 2.20 time: 0.176110 Oct 30 00:52:55.318988 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 261/536] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:55 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:52:55.809003 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2cc041b0-14d7-4e55-8e3a-67a6a4597ce0 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:55.809646 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2cc041b0-14d7-4e55-8e3a-67a6a4597ce0 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:55.816601 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2cc041b0-14d7-4e55-8e3a-67a6a4597ce0 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:55.817093 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2cc041b0-14d7-4e55-8e3a-67a6a4597ce0 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:55.817528 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2cc041b0-14d7-4e55-8e3a-67a6a4597ce0 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:55.818236 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2cc041b0-14d7-4e55-8e3a-67a6a4597ce0 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:55.818690 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2cc041b0-14d7-4e55-8e3a-67a6a4597ce0 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:55.819114 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2cc041b0-14d7-4e55-8e3a-67a6a4597ce0 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:55.856652 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2cc041b0-14d7-4e55-8e3a-67a6a4597ce0 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:55.857134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2cc041b0-14d7-4e55-8e3a-67a6a4597ce0 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:55.857565 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2cc041b0-14d7-4e55-8e3a-67a6a4597ce0 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:55.858026 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.objects.instance [None req-2cc041b0-14d7-4e55-8e3a-67a6a4597ce0 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lazy-loading 'fault' on Instance uuid 13b8bcf7-ff66-4a87-b856-9b46f05df0fe {{(pid=125554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:52:55.903301 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2cc041b0-14d7-4e55-8e3a-67a6a4597ce0 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:55.906790 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:52:55.912266 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2cc041b0-14d7-4e55-8e3a-67a6a4597ce0 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1304 microversion: 2.1 time: 0.108397 Oct 30 00:52:55.912769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 276/537] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:55 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:56.343582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1e9f246f-0d33-4d6e-bcf2-f0f9e1ab33cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:56.344327 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1e9f246f-0d33-4d6e-bcf2-f0f9e1ab33cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:56.350817 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1e9f246f-0d33-4d6e-bcf2-f0f9e1ab33cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:56.351302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1e9f246f-0d33-4d6e-bcf2-f0f9e1ab33cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:56.351738 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1e9f246f-0d33-4d6e-bcf2-f0f9e1ab33cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:56.352456 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1e9f246f-0d33-4d6e-bcf2-f0f9e1ab33cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:56.352912 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1e9f246f-0d33-4d6e-bcf2-f0f9e1ab33cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:56.353334 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1e9f246f-0d33-4d6e-bcf2-f0f9e1ab33cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:56.483424 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1e9f246f-0d33-4d6e-bcf2-f0f9e1ab33cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:56.491958 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1e9f246f-0d33-4d6e-bcf2-f0f9e1ab33cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:56.493431 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1e9f246f-0d33-4d6e-bcf2-f0f9e1ab33cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:56.494666 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1e9f246f-0d33-4d6e-bcf2-f0f9e1ab33cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1721 microversion: 2.20 time: 0.155024 Oct 30 00:52:56.495222 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 262/538] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:56 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:56.936564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-18d8237a-4eb4-4590-b44a-12cd694070d1 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:56.937160 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-18d8237a-4eb4-4590-b44a-12cd694070d1 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:56.945384 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-18d8237a-4eb4-4590-b44a-12cd694070d1 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:56.945858 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-18d8237a-4eb4-4590-b44a-12cd694070d1 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:56.946283 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-18d8237a-4eb4-4590-b44a-12cd694070d1 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:56.946961 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-18d8237a-4eb4-4590-b44a-12cd694070d1 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:56.947402 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-18d8237a-4eb4-4590-b44a-12cd694070d1 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:56.947816 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-18d8237a-4eb4-4590-b44a-12cd694070d1 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:56.978987 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-18d8237a-4eb4-4590-b44a-12cd694070d1 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:56.979474 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-18d8237a-4eb4-4590-b44a-12cd694070d1 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:56.979894 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-18d8237a-4eb4-4590-b44a-12cd694070d1 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:56.980352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.objects.instance [None req-18d8237a-4eb4-4590-b44a-12cd694070d1 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lazy-loading 'fault' on Instance uuid 13b8bcf7-ff66-4a87-b856-9b46f05df0fe {{(pid=125554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:52:57.024606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-18d8237a-4eb4-4590-b44a-12cd694070d1 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:57.032108 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-18d8237a-4eb4-4590-b44a-12cd694070d1 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1304 microversion: 2.1 time: 0.100249 Oct 30 00:52:57.032670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 277/539] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:56 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:57.521554 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-ba7384b6-181f-4825-a6d6-0d2c3f336cfa tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:57.522098 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-ba7384b6-181f-4825-a6d6-0d2c3f336cfa tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:57.528427 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ba7384b6-181f-4825-a6d6-0d2c3f336cfa tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:57.528899 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ba7384b6-181f-4825-a6d6-0d2c3f336cfa tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:57.529325 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ba7384b6-181f-4825-a6d6-0d2c3f336cfa tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:57.530004 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ba7384b6-181f-4825-a6d6-0d2c3f336cfa tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:57.530447 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ba7384b6-181f-4825-a6d6-0d2c3f336cfa tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:57.530861 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ba7384b6-181f-4825-a6d6-0d2c3f336cfa tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:57.658942 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ba7384b6-181f-4825-a6d6-0d2c3f336cfa tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:57.666979 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ba7384b6-181f-4825-a6d6-0d2c3f336cfa tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:57.668445 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ba7384b6-181f-4825-a6d6-0d2c3f336cfa tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:57.669591 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-ba7384b6-181f-4825-a6d6-0d2c3f336cfa tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1721 microversion: 2.20 time: 0.152782 Oct 30 00:52:57.670145 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 263/540] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:57 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:58.056171 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7afa0486-a224-4f9f-ac32-876779d519b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:58.056787 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-7afa0486-a224-4f9f-ac32-876779d519b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:58.062812 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7afa0486-a224-4f9f-ac32-876779d519b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:58.063297 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7afa0486-a224-4f9f-ac32-876779d519b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:58.063728 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7afa0486-a224-4f9f-ac32-876779d519b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:58.064444 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7afa0486-a224-4f9f-ac32-876779d519b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:58.064897 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7afa0486-a224-4f9f-ac32-876779d519b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:58.065345 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7afa0486-a224-4f9f-ac32-876779d519b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:58.095668 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7afa0486-a224-4f9f-ac32-876779d519b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:58.096346 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7afa0486-a224-4f9f-ac32-876779d519b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:58.097274 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7afa0486-a224-4f9f-ac32-876779d519b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:58.097708 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.objects.instance [None req-7afa0486-a224-4f9f-ac32-876779d519b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lazy-loading 'fault' on Instance uuid 13b8bcf7-ff66-4a87-b856-9b46f05df0fe {{(pid=125554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:52:58.137217 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7afa0486-a224-4f9f-ac32-876779d519b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:58.144746 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7afa0486-a224-4f9f-ac32-876779d519b9 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1304 microversion: 2.1 time: 0.092746 Oct 30 00:52:58.145303 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 278/541] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:58 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:58.695129 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-b2350cde-3d16-45aa-b7cd-4033f7526f1f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:58.695739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-b2350cde-3d16-45aa-b7cd-4033f7526f1f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:58.701845 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b2350cde-3d16-45aa-b7cd-4033f7526f1f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:58.702325 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b2350cde-3d16-45aa-b7cd-4033f7526f1f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:58.702758 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b2350cde-3d16-45aa-b7cd-4033f7526f1f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:58.703449 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b2350cde-3d16-45aa-b7cd-4033f7526f1f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:58.703902 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b2350cde-3d16-45aa-b7cd-4033f7526f1f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:58.704357 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b2350cde-3d16-45aa-b7cd-4033f7526f1f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:58.838240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-b2350cde-3d16-45aa-b7cd-4033f7526f1f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:58.846206 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-b2350cde-3d16-45aa-b7cd-4033f7526f1f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:58.848257 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-b2350cde-3d16-45aa-b7cd-4033f7526f1f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:58.849402 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-b2350cde-3d16-45aa-b7cd-4033f7526f1f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1721 microversion: 2.20 time: 0.158481 Oct 30 00:52:58.849951 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 264/542] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:58 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:52:59.167924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f43311d4-c6be-4523-b177-3216009a5a4d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:59.168554 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-f43311d4-c6be-4523-b177-3216009a5a4d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:59.175015 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f43311d4-c6be-4523-b177-3216009a5a4d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:59.175490 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f43311d4-c6be-4523-b177-3216009a5a4d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:59.175921 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f43311d4-c6be-4523-b177-3216009a5a4d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:59.176631 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f43311d4-c6be-4523-b177-3216009a5a4d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:59.177082 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f43311d4-c6be-4523-b177-3216009a5a4d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:59.177499 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f43311d4-c6be-4523-b177-3216009a5a4d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:59.208604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f43311d4-c6be-4523-b177-3216009a5a4d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:59.209075 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f43311d4-c6be-4523-b177-3216009a5a4d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:59.209503 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f43311d4-c6be-4523-b177-3216009a5a4d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:59.209940 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.objects.instance [None req-f43311d4-c6be-4523-b177-3216009a5a4d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lazy-loading 'fault' on Instance uuid 13b8bcf7-ff66-4a87-b856-9b46f05df0fe {{(pid=125554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:52:59.249748 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-f43311d4-c6be-4523-b177-3216009a5a4d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:52:59.258256 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-f43311d4-c6be-4523-b177-3216009a5a4d tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1304 microversion: 2.1 time: 0.094167 Oct 30 00:52:59.258816 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 279/543] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:52:59 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:52:59.876170 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-974781e0-2900-4ebe-b139-6806153d1ade tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:52:59.876782 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-974781e0-2900-4ebe-b139-6806153d1ade tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:52:59.883350 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-974781e0-2900-4ebe-b139-6806153d1ade tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:59.883832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-974781e0-2900-4ebe-b139-6806153d1ade tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:59.884303 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-974781e0-2900-4ebe-b139-6806153d1ade tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:52:59.884995 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-974781e0-2900-4ebe-b139-6806153d1ade tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:52:59.885445 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-974781e0-2900-4ebe-b139-6806153d1ade tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:52:59.885867 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-974781e0-2900-4ebe-b139-6806153d1ade tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:00.024552 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-974781e0-2900-4ebe-b139-6806153d1ade tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:00.032486 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-974781e0-2900-4ebe-b139-6806153d1ade tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:00.033921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-974781e0-2900-4ebe-b139-6806153d1ade tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:00.035879 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-974781e0-2900-4ebe-b139-6806153d1ade tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1721 microversion: 2.20 time: 0.163814 Oct 30 00:53:00.036466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 265/544] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:52:59 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:00.282197 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ee5e69a7-ffb6-4b6e-9e23-462bb79aa2b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:00.282850 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ee5e69a7-ffb6-4b6e-9e23-462bb79aa2b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:00.291005 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ee5e69a7-ffb6-4b6e-9e23-462bb79aa2b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:00.291493 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ee5e69a7-ffb6-4b6e-9e23-462bb79aa2b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:00.291928 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ee5e69a7-ffb6-4b6e-9e23-462bb79aa2b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:00.292664 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ee5e69a7-ffb6-4b6e-9e23-462bb79aa2b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:00.293186 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ee5e69a7-ffb6-4b6e-9e23-462bb79aa2b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:00.293927 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ee5e69a7-ffb6-4b6e-9e23-462bb79aa2b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:00.332598 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ee5e69a7-ffb6-4b6e-9e23-462bb79aa2b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:00.333454 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ee5e69a7-ffb6-4b6e-9e23-462bb79aa2b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:00.334165 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ee5e69a7-ffb6-4b6e-9e23-462bb79aa2b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:00.334618 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.objects.instance [None req-ee5e69a7-ffb6-4b6e-9e23-462bb79aa2b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lazy-loading 'fault' on Instance uuid 13b8bcf7-ff66-4a87-b856-9b46f05df0fe {{(pid=125554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:53:00.387026 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ee5e69a7-ffb6-4b6e-9e23-462bb79aa2b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b8683a89f043b792dc6ba73af2d22b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd870a579f94748d1998b1902b9dc8636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:00.396197 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ee5e69a7-ffb6-4b6e-9e23-462bb79aa2b3 tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 200 len: 1304 microversion: 2.1 time: 0.118313 Oct 30 00:53:00.397169 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 280/545] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:00 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:01.061349 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-68d630c3-b7ef-4976-9dd2-543abfe5b458 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:01.061954 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-68d630c3-b7ef-4976-9dd2-543abfe5b458 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:01.070272 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-68d630c3-b7ef-4976-9dd2-543abfe5b458 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:01.071052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-68d630c3-b7ef-4976-9dd2-543abfe5b458 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:01.071698 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-68d630c3-b7ef-4976-9dd2-543abfe5b458 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:01.072903 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-68d630c3-b7ef-4976-9dd2-543abfe5b458 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:01.073575 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-68d630c3-b7ef-4976-9dd2-543abfe5b458 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:01.074289 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-68d630c3-b7ef-4976-9dd2-543abfe5b458 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:01.171161 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-d6413d4e-4ff4-4d98-8a7f-89b466e174f4 req-36323861-3810-4dd3-b043-265bbf5ce9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00747eb3-1c2b-40b2-8e0a-9c440529e833", "name": "network-vif-unplugged", "status": "completed", "tag": "0b7471a7-8df2-4f56-8dad-8f89610685f3"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:53:01.191069 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-d6413d4e-4ff4-4d98-8a7f-89b466e174f4 req-36323861-3810-4dd3-b043-265bbf5ce9c9 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:01.192229 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-d6413d4e-4ff4-4d98-8a7f-89b466e174f4 req-36323861-3810-4dd3-b043-265bbf5ce9c9 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:01.192901 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-d6413d4e-4ff4-4d98-8a7f-89b466e174f4 req-36323861-3810-4dd3-b043-265bbf5ce9c9 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:01.206971 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-d6413d4e-4ff4-4d98-8a7f-89b466e174f4 req-36323861-3810-4dd3-b043-265bbf5ce9c9 service nova] Creating event network-vif-unplugged:0b7471a7-8df2-4f56-8dad-8f89610685f3 for instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 on hv-cinder-86149 Oct 30 00:53:01.213279 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-d6413d4e-4ff4-4d98-8a7f-89b466e174f4 req-36323861-3810-4dd3-b043-265bbf5ce9c9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046897 Oct 30 00:53:01.214609 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 281/546] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:53:01.238490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-68d630c3-b7ef-4976-9dd2-543abfe5b458 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:01.247747 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-68d630c3-b7ef-4976-9dd2-543abfe5b458 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:01.249519 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-68d630c3-b7ef-4976-9dd2-543abfe5b458 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:01.250940 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-68d630c3-b7ef-4976-9dd2-543abfe5b458 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1721 microversion: 2.20 time: 0.193440 Oct 30 00:53:01.251779 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 266/547] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:01 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:01.421375 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-72f6f6c7-9543-4af5-a6f5-04ea738d35df tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:01.422067 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-72f6f6c7-9543-4af5-a6f5-04ea738d35df tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] [instance: 13b8bcf7-ff66-4a87-b856-9b46f05df0fe] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:01.428219 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-72f6f6c7-9543-4af5-a6f5-04ea738d35df tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:01.428692 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-72f6f6c7-9543-4af5-a6f5-04ea738d35df tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:01.429120 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-72f6f6c7-9543-4af5-a6f5-04ea738d35df tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:01.429797 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-72f6f6c7-9543-4af5-a6f5-04ea738d35df tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:01.430241 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-72f6f6c7-9543-4af5-a6f5-04ea738d35df tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:01.430663 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-72f6f6c7-9543-4af5-a6f5-04ea738d35df tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:01.444365 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-72f6f6c7-9543-4af5-a6f5-04ea738d35df tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] HTTP exception thrown: Instance 13b8bcf7-ff66-4a87-b856-9b46f05df0fe could not be found. Oct 30 00:53:01.446253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-72f6f6c7-9543-4af5-a6f5-04ea738d35df tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Request method failure captured: Oct 30 00:53:01.446253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe HTTP/1.1 Oct 30 00:53:01.446253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 00:53:01.446253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 00:53:01.446253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 00:53:01.446253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 00:53:01.446253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 00:53:01.446253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 00:53:01.446253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 00:53:01.446253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 00:53:01.446253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcq0ThAOvfsU4S7kAUGJN3sZ0r8T80qDSFNZbNVsRJItsj_DHAm7p2__MmlinQuQyOmkm7WIpaHaGAncNVclUmnpyqfquIiIG_Mj7zM0aBLCaGEor81VlJo66YItzmOtdJNOyGAOYs176suc5PvBR9iE8u8tUMYdLO0BgXJ8zrxWD_c Oct 30 00:53:01.446253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 00:53:01.446253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 00:53:01.446253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 00:53:01.446253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 00:53:01.446253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 00:53:01.446253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 00:53:01.446253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: d870a579f94748d1998b1902b9dc8636 Oct 30 00:53:01.446253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-VolumesActionsTest-1632664077 Oct 30 00:53:01.446253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 00:53:01.446253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 00:53:01.447794 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d870a579f94748d1998b1902b9dc8636"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d870a579f94748d1998b1902b9dc8636"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d870a579f94748d1998b1902b9dc8636"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d870a579f94748d1998b1902b9dc8636"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:53:01.447794 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-VolumesActionsTest-1632664077 Oct 30 00:53:01.447794 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: d870a579f94748d1998b1902b9dc8636 Oct 30 00:53:01.447794 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-VolumesActionsTest-1632664077 Oct 30 00:53:01.447794 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-VolumesActionsTest-1632664077-project Oct 30 00:53:01.447794 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 00:53:01.447794 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 00:53:01.447794 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: b8b8683a89f043b792dc6ba73af2d22b Oct 30 00:53:01.447794 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-VolumesActionsTest-1632664077-project Oct 30 00:53:01.447794 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 00:53:01.447794 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Instance 13b8bcf7-ff66-4a87-b856-9b46f05df0fe could not be found. Oct 30 00:53:01.447794 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': '13b8bcf7-ff66-4a87-b856-9b46f05df0fe'} Oct 30 00:53:01.448709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:53:01.448709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:53:01.448709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:53:01.448709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:53:01.448709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:53:01.448709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:53:01.448709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:53:01.448709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:53:01.448709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:53:01.448709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:53:01.448709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13b8bcf7-ff66-4a87-b856-9b46f05df0fe could not be found. Oct 30 00:53:01.448709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:53:01.448709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:53:01.448709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:53:01.448709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:53:01.448709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:53:01.448709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:53:01.448709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:53:01.448709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:53:01.448709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:53:01.450261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:53:01.450261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 00:53:01.450261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 00:53:01.450261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:53:01.450261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:53:01.450261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:53:01.450261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:53:01.450261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13b8bcf7-ff66-4a87-b856-9b46f05df0fe could not be found. Oct 30 00:53:01.450261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:53:01.450261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:53:01.450261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:53:01.450261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:53:01.450261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:53:01.450261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:53:01.450261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:53:01.450261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:53:01.450261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13b8bcf7-ff66-4a87-b856-9b46f05df0fe could not be found. Oct 30 00:53:01.450261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:53:01.451527 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-72f6f6c7-9543-4af5-a6f5-04ea738d35df tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] Returning 404 to user: Instance 13b8bcf7-ff66-4a87-b856-9b46f05df0fe could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:53:01.451527 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-72f6f6c7-9543-4af5-a6f5-04ea738d35df tempest-VolumesActionsTest-1632664077 tempest-VolumesActionsTest-1632664077-project] 10.222.0.36 "GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe" status: 404 len: 111 microversion: 2.1 time: 0.030879 Oct 30 00:53:01.451527 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 282/548] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:01 2022] GET /compute/v2.1/servers/13b8bcf7-ff66-4a87-b856-9b46f05df0fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 00:53:01.626639 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3ac5cc91-c693-4502-aee7-d86c770ccf1c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:53:01.633464 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3ac5cc91-c693-4502-aee7-d86c770ccf1c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:01.633954 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3ac5cc91-c693-4502-aee7-d86c770ccf1c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:01.634395 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3ac5cc91-c693-4502-aee7-d86c770ccf1c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:01.696487 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-3ac5cc91-c693-4502-aee7-d86c770ccf1c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Going to try to stop instance {{(pid=125553) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 30 00:53:01.749620 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-3ac5cc91-c693-4502-aee7-d86c770ccf1c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "POST /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26/action" status: 202 len: 0 microversion: 2.1 time: 0.119179 Oct 30 00:53:01.749620 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 267/549] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Oct 30 00:53:01 2022] POST /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 00:53:01.750687 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2be3e124-c717-4771-aa67-9f41358d1c2b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:01.751283 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2be3e124-c717-4771-aa67-9f41358d1c2b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:01.758857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2be3e124-c717-4771-aa67-9f41358d1c2b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:01.759336 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2be3e124-c717-4771-aa67-9f41358d1c2b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:01.759759 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2be3e124-c717-4771-aa67-9f41358d1c2b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:01.760465 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2be3e124-c717-4771-aa67-9f41358d1c2b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:01.760910 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2be3e124-c717-4771-aa67-9f41358d1c2b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:01.761329 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2be3e124-c717-4771-aa67-9f41358d1c2b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:01.901747 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2be3e124-c717-4771-aa67-9f41358d1c2b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:01.909996 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2be3e124-c717-4771-aa67-9f41358d1c2b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.163188 Oct 30 00:53:01.910542 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 283/550] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:01 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:02.278366 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-8a247f73-377a-4e88-811a-a5b5e6067da6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:02.279053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-8a247f73-377a-4e88-811a-a5b5e6067da6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:02.285793 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a247f73-377a-4e88-811a-a5b5e6067da6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:02.286270 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a247f73-377a-4e88-811a-a5b5e6067da6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:02.286703 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a247f73-377a-4e88-811a-a5b5e6067da6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:02.287390 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a247f73-377a-4e88-811a-a5b5e6067da6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:02.287839 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a247f73-377a-4e88-811a-a5b5e6067da6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:02.288367 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a247f73-377a-4e88-811a-a5b5e6067da6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:02.428271 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8a247f73-377a-4e88-811a-a5b5e6067da6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:02.436343 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8a247f73-377a-4e88-811a-a5b5e6067da6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:02.437811 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8a247f73-377a-4e88-811a-a5b5e6067da6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:02.438948 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-8a247f73-377a-4e88-811a-a5b5e6067da6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1721 microversion: 2.20 time: 0.164806 Oct 30 00:53:02.439487 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 268/551] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:02 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:02.933353 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-58a1abce-fc5b-4cd3-851e-0689a8d829c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:02.934017 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-58a1abce-fc5b-4cd3-851e-0689a8d829c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:02.940644 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58a1abce-fc5b-4cd3-851e-0689a8d829c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:02.941139 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58a1abce-fc5b-4cd3-851e-0689a8d829c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:02.941570 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58a1abce-fc5b-4cd3-851e-0689a8d829c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:02.942296 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58a1abce-fc5b-4cd3-851e-0689a8d829c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:02.942749 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58a1abce-fc5b-4cd3-851e-0689a8d829c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:02.943170 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58a1abce-fc5b-4cd3-851e-0689a8d829c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:03.071085 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-58a1abce-fc5b-4cd3-851e-0689a8d829c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:03.079128 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-58a1abce-fc5b-4cd3-851e-0689a8d829c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.149937 Oct 30 00:53:03.079664 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 284/552] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:02 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:03.467021 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-56f37b27-de9e-457c-b3cc-b4e2f2788516 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:03.467562 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-56f37b27-de9e-457c-b3cc-b4e2f2788516 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:03.474025 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-56f37b27-de9e-457c-b3cc-b4e2f2788516 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:03.474508 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-56f37b27-de9e-457c-b3cc-b4e2f2788516 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:03.474950 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-56f37b27-de9e-457c-b3cc-b4e2f2788516 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:03.475643 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-56f37b27-de9e-457c-b3cc-b4e2f2788516 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:03.476112 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-56f37b27-de9e-457c-b3cc-b4e2f2788516 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:03.476539 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-56f37b27-de9e-457c-b3cc-b4e2f2788516 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:03.608517 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-56f37b27-de9e-457c-b3cc-b4e2f2788516 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:03.616718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-56f37b27-de9e-457c-b3cc-b4e2f2788516 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:03.618421 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-56f37b27-de9e-457c-b3cc-b4e2f2788516 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:03.619786 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-56f37b27-de9e-457c-b3cc-b4e2f2788516 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1721 microversion: 2.20 time: 0.156765 Oct 30 00:53:03.620485 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 269/553] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:03 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:04.103717 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7d0afd88-0cc3-4598-b77a-8e748914622f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:04.104340 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-7d0afd88-0cc3-4598-b77a-8e748914622f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:04.110703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7d0afd88-0cc3-4598-b77a-8e748914622f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:04.111178 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7d0afd88-0cc3-4598-b77a-8e748914622f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:04.111601 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7d0afd88-0cc3-4598-b77a-8e748914622f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:04.112488 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7d0afd88-0cc3-4598-b77a-8e748914622f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:04.113747 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7d0afd88-0cc3-4598-b77a-8e748914622f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:04.114191 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7d0afd88-0cc3-4598-b77a-8e748914622f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:04.241859 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7d0afd88-0cc3-4598-b77a-8e748914622f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:04.249976 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7d0afd88-0cc3-4598-b77a-8e748914622f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.150131 Oct 30 00:53:04.250551 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 285/554] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:04 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:04.646048 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-76a3ab9a-0900-4876-904e-3377101675c0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:04.646669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-76a3ab9a-0900-4876-904e-3377101675c0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:04.652978 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-76a3ab9a-0900-4876-904e-3377101675c0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:04.653454 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-76a3ab9a-0900-4876-904e-3377101675c0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:04.653881 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-76a3ab9a-0900-4876-904e-3377101675c0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:04.654564 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-76a3ab9a-0900-4876-904e-3377101675c0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:04.655040 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-76a3ab9a-0900-4876-904e-3377101675c0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:04.655461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-76a3ab9a-0900-4876-904e-3377101675c0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:04.783904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-76a3ab9a-0900-4876-904e-3377101675c0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:04.792182 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-76a3ab9a-0900-4876-904e-3377101675c0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:04.793625 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-76a3ab9a-0900-4876-904e-3377101675c0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:04.794774 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-76a3ab9a-0900-4876-904e-3377101675c0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1721 microversion: 2.20 time: 0.152855 Oct 30 00:53:04.795321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 270/555] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:04 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:05.274789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-95c59f25-3163-4bda-b266-14c5c5d1f327 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:05.275398 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-95c59f25-3163-4bda-b266-14c5c5d1f327 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:05.281970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-95c59f25-3163-4bda-b266-14c5c5d1f327 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:05.282455 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-95c59f25-3163-4bda-b266-14c5c5d1f327 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:05.282886 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-95c59f25-3163-4bda-b266-14c5c5d1f327 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:05.283579 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-95c59f25-3163-4bda-b266-14c5c5d1f327 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:05.284031 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-95c59f25-3163-4bda-b266-14c5c5d1f327 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:05.285114 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-95c59f25-3163-4bda-b266-14c5c5d1f327 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:05.416263 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-95c59f25-3163-4bda-b266-14c5c5d1f327 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:05.424580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-95c59f25-3163-4bda-b266-14c5c5d1f327 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.154346 Oct 30 00:53:05.425141 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 286/556] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:05 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:05.822077 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-369b1d78-6258-4f44-b708-4ce9fc9dc2c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:05.822656 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-369b1d78-6258-4f44-b708-4ce9fc9dc2c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:05.828664 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-369b1d78-6258-4f44-b708-4ce9fc9dc2c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:05.829138 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-369b1d78-6258-4f44-b708-4ce9fc9dc2c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:05.829562 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-369b1d78-6258-4f44-b708-4ce9fc9dc2c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:05.830240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-369b1d78-6258-4f44-b708-4ce9fc9dc2c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:05.830722 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-369b1d78-6258-4f44-b708-4ce9fc9dc2c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:05.831143 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-369b1d78-6258-4f44-b708-4ce9fc9dc2c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:05.846316 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:05.961058 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-369b1d78-6258-4f44-b708-4ce9fc9dc2c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:05.968993 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-369b1d78-6258-4f44-b708-4ce9fc9dc2c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:05.970411 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-369b1d78-6258-4f44-b708-4ce9fc9dc2c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:05.971547 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-369b1d78-6258-4f44-b708-4ce9fc9dc2c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1721 microversion: 2.20 time: 0.153739 Oct 30 00:53:05.972606 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 271/557] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:05 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:06.448105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d5f49da7-2397-480f-a1ff-27f64b17da58 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:06.448719 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-d5f49da7-2397-480f-a1ff-27f64b17da58 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:06.455063 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d5f49da7-2397-480f-a1ff-27f64b17da58 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:06.455539 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d5f49da7-2397-480f-a1ff-27f64b17da58 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:06.455971 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d5f49da7-2397-480f-a1ff-27f64b17da58 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:06.456720 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d5f49da7-2397-480f-a1ff-27f64b17da58 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:06.457170 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d5f49da7-2397-480f-a1ff-27f64b17da58 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:06.457589 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d5f49da7-2397-480f-a1ff-27f64b17da58 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:06.592917 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-d5f49da7-2397-480f-a1ff-27f64b17da58 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:06.602932 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-d5f49da7-2397-480f-a1ff-27f64b17da58 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.158957 Oct 30 00:53:06.603720 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 287/558] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:06 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:06.997240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-712d939a-8b50-490d-8944-300a1eea2175 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:06.997881 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-712d939a-8b50-490d-8944-300a1eea2175 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:07.004492 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-712d939a-8b50-490d-8944-300a1eea2175 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:07.004975 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-712d939a-8b50-490d-8944-300a1eea2175 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:07.005408 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-712d939a-8b50-490d-8944-300a1eea2175 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:07.006101 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-712d939a-8b50-490d-8944-300a1eea2175 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:07.006554 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-712d939a-8b50-490d-8944-300a1eea2175 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:07.006976 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-712d939a-8b50-490d-8944-300a1eea2175 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:07.250521 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-712d939a-8b50-490d-8944-300a1eea2175 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:07.259706 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-712d939a-8b50-490d-8944-300a1eea2175 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:07.261180 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-712d939a-8b50-490d-8944-300a1eea2175 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:07.262448 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-712d939a-8b50-490d-8944-300a1eea2175 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1721 microversion: 2.20 time: 0.269100 Oct 30 00:53:07.262995 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 272/559] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:06 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1721 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:07.627097 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-692b1bc0-7574-4794-acfa-31fc78b19fb4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:07.627754 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-692b1bc0-7574-4794-acfa-31fc78b19fb4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:07.634983 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-692b1bc0-7574-4794-acfa-31fc78b19fb4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:07.635455 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-692b1bc0-7574-4794-acfa-31fc78b19fb4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:07.635884 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-692b1bc0-7574-4794-acfa-31fc78b19fb4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:07.636585 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-692b1bc0-7574-4794-acfa-31fc78b19fb4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:07.637033 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-692b1bc0-7574-4794-acfa-31fc78b19fb4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:07.637448 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-692b1bc0-7574-4794-acfa-31fc78b19fb4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:07.768924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-692b1bc0-7574-4794-acfa-31fc78b19fb4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:07.777202 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-692b1bc0-7574-4794-acfa-31fc78b19fb4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.153970 Oct 30 00:53:07.777749 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 288/560] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:07 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:08.289811 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-eec47ac9-5aa3-4f44-9115-8eceb4e46802 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:08.290500 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-eec47ac9-5aa3-4f44-9115-8eceb4e46802 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:08.297758 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-eec47ac9-5aa3-4f44-9115-8eceb4e46802 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:08.298242 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-eec47ac9-5aa3-4f44-9115-8eceb4e46802 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:08.298675 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-eec47ac9-5aa3-4f44-9115-8eceb4e46802 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:08.299372 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-eec47ac9-5aa3-4f44-9115-8eceb4e46802 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:08.299822 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-eec47ac9-5aa3-4f44-9115-8eceb4e46802 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:08.300854 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-eec47ac9-5aa3-4f44-9115-8eceb4e46802 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:08.448253 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-eec47ac9-5aa3-4f44-9115-8eceb4e46802 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:08.456699 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-eec47ac9-5aa3-4f44-9115-8eceb4e46802 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:08.458169 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-eec47ac9-5aa3-4f44-9115-8eceb4e46802 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:08.459366 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-eec47ac9-5aa3-4f44-9115-8eceb4e46802 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1724 microversion: 2.20 time: 0.173489 Oct 30 00:53:08.459976 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 273/561] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:08 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:53:08.484840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-0a477d09-89f6-41c9-883b-0968d97d9cc3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f0e847c-44e2-4689-8000-222c1111e4b9"}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:53:08.487104 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-0a477d09-89f6-41c9-883b-0968d97d9cc3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:08.493460 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0a477d09-89f6-41c9-883b-0968d97d9cc3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:08.493937 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0a477d09-89f6-41c9-883b-0968d97d9cc3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:08.494360 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0a477d09-89f6-41c9-883b-0968d97d9cc3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:08.495033 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0a477d09-89f6-41c9-883b-0968d97d9cc3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:08.495474 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0a477d09-89f6-41c9-883b-0968d97d9cc3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:08.495887 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0a477d09-89f6-41c9-883b-0968d97d9cc3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:08.775951 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-0a477d09-89f6-41c9-883b-0968d97d9cc3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "POST /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.295944 Oct 30 00:53:08.776672 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 289/562] 10.222.0.36 () {62 vars in 1364 bytes} [Sun Oct 30 00:53:08 2022] POST /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833/os-volume_attachments => generated 188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:53:08.801667 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-61eec71c-5926-4376-805b-0c4f72abd20b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:08.802201 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-61eec71c-5926-4376-805b-0c4f72abd20b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:08.808286 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-61eec71c-5926-4376-805b-0c4f72abd20b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:08.808766 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-61eec71c-5926-4376-805b-0c4f72abd20b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:08.809197 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-61eec71c-5926-4376-805b-0c4f72abd20b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:08.809923 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-61eec71c-5926-4376-805b-0c4f72abd20b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:08.810371 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-61eec71c-5926-4376-805b-0c4f72abd20b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:08.810789 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-61eec71c-5926-4376-805b-0c4f72abd20b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:08.906709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-33dd7b75-f8ab-4f46-93e1-65c83b3a66b8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:53:08.907302 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-33dd7b75-f8ab-4f46-93e1-65c83b3a66b8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:08.913912 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-33dd7b75-f8ab-4f46-93e1-65c83b3a66b8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:08.914389 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-33dd7b75-f8ab-4f46-93e1-65c83b3a66b8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:08.914825 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-33dd7b75-f8ab-4f46-93e1-65c83b3a66b8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:08.915513 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-33dd7b75-f8ab-4f46-93e1-65c83b3a66b8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:08.915961 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-33dd7b75-f8ab-4f46-93e1-65c83b3a66b8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:08.916412 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-33dd7b75-f8ab-4f46-93e1-65c83b3a66b8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:08.946406 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-61eec71c-5926-4376-805b-0c4f72abd20b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:08.954639 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-61eec71c-5926-4376-805b-0c4f72abd20b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.157604 Oct 30 00:53:08.955195 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 274/563] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:08 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:08.963320 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-33dd7b75-f8ab-4f46-93e1-65c83b3a66b8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125554) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 30 00:53:08.986795 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:09.033789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-33dd7b75-f8ab-4f46-93e1-65c83b3a66b8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "POST /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833/action" status: 202 len: 0 microversion: 2.20 time: 0.130810 Oct 30 00:53:09.037145 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 290/564] 10.222.0.36 () {62 vars in 1319 bytes} [Sun Oct 30 00:53:08 2022] POST /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 30 00:53:09.043077 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-9791a40d-c294-4bf8-b1bb-82930d253881 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:09.044042 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-9791a40d-c294-4bf8-b1bb-82930d253881 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:09.050037 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9791a40d-c294-4bf8-b1bb-82930d253881 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:09.050610 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9791a40d-c294-4bf8-b1bb-82930d253881 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:09.051045 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9791a40d-c294-4bf8-b1bb-82930d253881 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:09.051788 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9791a40d-c294-4bf8-b1bb-82930d253881 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:09.052242 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9791a40d-c294-4bf8-b1bb-82930d253881 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:09.052644 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9791a40d-c294-4bf8-b1bb-82930d253881 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:09.186121 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-9791a40d-c294-4bf8-b1bb-82930d253881 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:09.194804 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-9791a40d-c294-4bf8-b1bb-82930d253881 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:09.196522 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-9791a40d-c294-4bf8-b1bb-82930d253881 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:09.197677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-9791a40d-c294-4bf8-b1bb-82930d253881 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1750 microversion: 2.20 time: 0.158530 Oct 30 00:53:09.198223 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 275/565] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:09 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1750 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:53:09.467530 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-07e2abc9-b1b3-4209-8529-54d59730998e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:09.467991 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-07e2abc9-b1b3-4209-8529-54d59730998e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:09.475615 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-07e2abc9-b1b3-4209-8529-54d59730998e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:09.476121 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-07e2abc9-b1b3-4209-8529-54d59730998e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:09.476565 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-07e2abc9-b1b3-4209-8529-54d59730998e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:09.477267 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-07e2abc9-b1b3-4209-8529-54d59730998e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:09.477713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-07e2abc9-b1b3-4209-8529-54d59730998e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:09.478132 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-07e2abc9-b1b3-4209-8529-54d59730998e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:09.722580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.objects.instance [None req-07e2abc9-b1b3-4209-8529-54d59730998e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lazy-loading 'services' on Instance uuid be9e8cf5-e50a-4fab-b8ce-c388caa2223f {{(pid=125554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:53:09.907798 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-07e2abc9-b1b3-4209-8529-54d59730998e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "DELETE /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f/os-volume_attachments/6517a4c9-353f-4caa-8cef-d4a8117c200d" status: 202 len: 0 microversion: 2.1 time: 0.444745 Oct 30 00:53:09.909767 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 291/566] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Oct 30 00:53:09 2022] DELETE /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f/os-volume_attachments/6517a4c9-353f-4caa-8cef-d4a8117c200d => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 00:53:09.982747 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3cf5893f-5835-49fa-8ca0-90a9770cdaa8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:09.985336 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-3cf5893f-5835-49fa-8ca0-90a9770cdaa8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:10.004310 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3cf5893f-5835-49fa-8ca0-90a9770cdaa8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:10.004310 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3cf5893f-5835-49fa-8ca0-90a9770cdaa8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:10.005708 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3cf5893f-5835-49fa-8ca0-90a9770cdaa8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:10.009495 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3cf5893f-5835-49fa-8ca0-90a9770cdaa8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:10.010191 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3cf5893f-5835-49fa-8ca0-90a9770cdaa8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:10.012582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3cf5893f-5835-49fa-8ca0-90a9770cdaa8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:10.202195 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3cf5893f-5835-49fa-8ca0-90a9770cdaa8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:10.212430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-3cf5893f-5835-49fa-8ca0-90a9770cdaa8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.235357 Oct 30 00:53:10.213275 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 276/567] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:09 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:10.227810 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-93c55f25-43de-42e7-85d1-128f24a31643 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:10.232076 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-93c55f25-43de-42e7-85d1-128f24a31643 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:10.242199 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-93c55f25-43de-42e7-85d1-128f24a31643 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:10.242957 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-93c55f25-43de-42e7-85d1-128f24a31643 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:10.243442 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-93c55f25-43de-42e7-85d1-128f24a31643 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:10.244176 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-93c55f25-43de-42e7-85d1-128f24a31643 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:10.244657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-93c55f25-43de-42e7-85d1-128f24a31643 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:10.245057 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-93c55f25-43de-42e7-85d1-128f24a31643 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:10.418481 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-93c55f25-43de-42e7-85d1-128f24a31643 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:10.428211 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-93c55f25-43de-42e7-85d1-128f24a31643 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:10.429643 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-93c55f25-43de-42e7-85d1-128f24a31643 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:10.430806 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-93c55f25-43de-42e7-85d1-128f24a31643 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1750 microversion: 2.20 time: 0.211181 Oct 30 00:53:10.432265 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 292/568] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:10 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1750 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:11.245794 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e35e362e-06a7-4b4b-9553-4f0883bdc4da tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:11.246400 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-e35e362e-06a7-4b4b-9553-4f0883bdc4da tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:11.255363 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e35e362e-06a7-4b4b-9553-4f0883bdc4da tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:11.256104 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e35e362e-06a7-4b4b-9553-4f0883bdc4da tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:11.256536 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e35e362e-06a7-4b4b-9553-4f0883bdc4da tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:11.257231 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e35e362e-06a7-4b4b-9553-4f0883bdc4da tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:11.257679 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e35e362e-06a7-4b4b-9553-4f0883bdc4da tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:11.258095 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e35e362e-06a7-4b4b-9553-4f0883bdc4da tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:11.424167 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-e35e362e-06a7-4b4b-9553-4f0883bdc4da tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:11.432467 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e35e362e-06a7-4b4b-9553-4f0883bdc4da tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.191011 Oct 30 00:53:11.433559 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 277/569] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:11 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:11.460511 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ca9c155a-f870-4fb9-8ec6-4ed4b81e85e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:11.461265 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ca9c155a-f870-4fb9-8ec6-4ed4b81e85e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:11.467816 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca9c155a-f870-4fb9-8ec6-4ed4b81e85e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:11.468539 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca9c155a-f870-4fb9-8ec6-4ed4b81e85e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:11.468966 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca9c155a-f870-4fb9-8ec6-4ed4b81e85e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:11.469768 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca9c155a-f870-4fb9-8ec6-4ed4b81e85e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:11.470341 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca9c155a-f870-4fb9-8ec6-4ed4b81e85e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:11.470775 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca9c155a-f870-4fb9-8ec6-4ed4b81e85e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:11.622888 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ca9c155a-f870-4fb9-8ec6-4ed4b81e85e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:11.633439 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ca9c155a-f870-4fb9-8ec6-4ed4b81e85e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:11.635201 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ca9c155a-f870-4fb9-8ec6-4ed4b81e85e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:11.636372 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ca9c155a-f870-4fb9-8ec6-4ed4b81e85e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1752 microversion: 2.20 time: 0.182046 Oct 30 00:53:11.636968 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 293/570] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:11 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1752 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:12.158953 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-bfcb9131-2d16-4fc2-bbc6-a0305f90e228 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:12.159582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-bfcb9131-2d16-4fc2-bbc6-a0305f90e228 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:12.167801 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bfcb9131-2d16-4fc2-bbc6-a0305f90e228 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:12.168735 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bfcb9131-2d16-4fc2-bbc6-a0305f90e228 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:12.169479 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bfcb9131-2d16-4fc2-bbc6-a0305f90e228 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:12.170431 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bfcb9131-2d16-4fc2-bbc6-a0305f90e228 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:12.171123 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bfcb9131-2d16-4fc2-bbc6-a0305f90e228 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:12.171794 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bfcb9131-2d16-4fc2-bbc6-a0305f90e228 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:12.206855 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-bfcb9131-2d16-4fc2-bbc6-a0305f90e228 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Going to try to terminate instance {{(pid=125553) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 00:53:12.296921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-bfcb9131-2d16-4fc2-bbc6-a0305f90e228 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "DELETE /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 204 len: 0 microversion: 2.1 time: 0.141043 Oct 30 00:53:12.303042 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 278/571] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 00:53:12 2022] DELETE /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 00:53:12.307733 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-fe930d11-3913-46c2-99c7-74573b299094 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:12.308617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-fe930d11-3913-46c2-99c7-74573b299094 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:12.319333 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fe930d11-3913-46c2-99c7-74573b299094 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:12.320501 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fe930d11-3913-46c2-99c7-74573b299094 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:12.321158 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fe930d11-3913-46c2-99c7-74573b299094 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:12.322060 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fe930d11-3913-46c2-99c7-74573b299094 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:12.322729 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fe930d11-3913-46c2-99c7-74573b299094 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:12.323726 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fe930d11-3913-46c2-99c7-74573b299094 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:12.469233 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c5c385b5-a945-4643-b34d-ba6e330bf9b4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:12.469233 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-c5c385b5-a945-4643-b34d-ba6e330bf9b4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:12.476374 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c5c385b5-a945-4643-b34d-ba6e330bf9b4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:12.480465 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c5c385b5-a945-4643-b34d-ba6e330bf9b4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:12.483550 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c5c385b5-a945-4643-b34d-ba6e330bf9b4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:12.484673 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c5c385b5-a945-4643-b34d-ba6e330bf9b4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:12.485444 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c5c385b5-a945-4643-b34d-ba6e330bf9b4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:12.487047 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c5c385b5-a945-4643-b34d-ba6e330bf9b4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:12.646966 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-fe930d11-3913-46c2-99c7-74573b299094 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:12.669542 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-fe930d11-3913-46c2-99c7-74573b299094 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 200 len: 1512 microversion: 2.1 time: 0.363975 Oct 30 00:53:12.685275 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 294/572] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:12 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 1512 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:53:12.690557 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-fe925a2b-d8ed-42cf-9394-52b8730e596d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:12.691253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-fe925a2b-d8ed-42cf-9394-52b8730e596d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:12.698711 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fe925a2b-d8ed-42cf-9394-52b8730e596d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:12.699197 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fe925a2b-d8ed-42cf-9394-52b8730e596d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:12.699690 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fe925a2b-d8ed-42cf-9394-52b8730e596d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:12.700623 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fe925a2b-d8ed-42cf-9394-52b8730e596d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:12.701264 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fe925a2b-d8ed-42cf-9394-52b8730e596d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:12.701744 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fe925a2b-d8ed-42cf-9394-52b8730e596d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:12.715770 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c5c385b5-a945-4643-b34d-ba6e330bf9b4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:12.724897 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c5c385b5-a945-4643-b34d-ba6e330bf9b4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.268982 Oct 30 00:53:12.726416 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 279/573] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:12 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:53:12.856509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-fe925a2b-d8ed-42cf-9394-52b8730e596d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:12.866509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-fe925a2b-d8ed-42cf-9394-52b8730e596d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:12.869047 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-fe925a2b-d8ed-42cf-9394-52b8730e596d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:12.870476 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-fe925a2b-d8ed-42cf-9394-52b8730e596d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.183822 Oct 30 00:53:12.871115 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 295/574] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:12 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:13.696594 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f40b2115-8efd-4418-afa8-6e17afd29b68 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:13.697342 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f40b2115-8efd-4418-afa8-6e17afd29b68 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:13.703580 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f40b2115-8efd-4418-afa8-6e17afd29b68 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:13.704072 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f40b2115-8efd-4418-afa8-6e17afd29b68 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:13.704527 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f40b2115-8efd-4418-afa8-6e17afd29b68 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:13.705225 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f40b2115-8efd-4418-afa8-6e17afd29b68 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:13.705672 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f40b2115-8efd-4418-afa8-6e17afd29b68 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:13.706094 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f40b2115-8efd-4418-afa8-6e17afd29b68 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:13.748933 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-136bce03-ec08-48f7-8407-1b53c151f466 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:13.750140 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-136bce03-ec08-48f7-8407-1b53c151f466 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:13.757886 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-136bce03-ec08-48f7-8407-1b53c151f466 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:13.758795 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-136bce03-ec08-48f7-8407-1b53c151f466 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:13.759396 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-136bce03-ec08-48f7-8407-1b53c151f466 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:13.760397 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-136bce03-ec08-48f7-8407-1b53c151f466 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:13.760772 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-136bce03-ec08-48f7-8407-1b53c151f466 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:13.761192 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-136bce03-ec08-48f7-8407-1b53c151f466 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:13.991218 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-136bce03-ec08-48f7-8407-1b53c151f466 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:14.002617 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f40b2115-8efd-4418-afa8-6e17afd29b68 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:14.016929 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-136bce03-ec08-48f7-8407-1b53c151f466 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.271674 Oct 30 00:53:14.017510 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 296/575] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:13 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:53:14.018423 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f40b2115-8efd-4418-afa8-6e17afd29b68 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 200 len: 1512 microversion: 2.1 time: 0.329416 Oct 30 00:53:14.019137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 280/576] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:13 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 1512 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:14.039979 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-06830047-3a01-489a-bc0d-9a5d5b785292 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:14.040629 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-06830047-3a01-489a-bc0d-9a5d5b785292 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:14.047250 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-06830047-3a01-489a-bc0d-9a5d5b785292 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:14.047976 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-06830047-3a01-489a-bc0d-9a5d5b785292 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:14.048693 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-06830047-3a01-489a-bc0d-9a5d5b785292 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:14.049568 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-06830047-3a01-489a-bc0d-9a5d5b785292 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:14.050199 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-06830047-3a01-489a-bc0d-9a5d5b785292 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:14.050779 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-06830047-3a01-489a-bc0d-9a5d5b785292 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:14.200865 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-06830047-3a01-489a-bc0d-9a5d5b785292 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:14.210627 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-06830047-3a01-489a-bc0d-9a5d5b785292 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:14.212060 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-06830047-3a01-489a-bc0d-9a5d5b785292 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:14.213542 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-06830047-3a01-489a-bc0d-9a5d5b785292 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.179965 Oct 30 00:53:14.224336 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 281/577] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:14 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:15.043459 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-026b7ec6-08e5-42b2-8b48-dd89a07c7ff4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:15.044832 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-026b7ec6-08e5-42b2-8b48-dd89a07c7ff4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:15.046805 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-b0dde10b-84a0-4369-9e38-19ef670baee7 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:15.048122 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:15.050197 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-b0dde10b-84a0-4369-9e38-19ef670baee7 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:15.055364 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-026b7ec6-08e5-42b2-8b48-dd89a07c7ff4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:15.058100 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b0dde10b-84a0-4369-9e38-19ef670baee7 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:15.061110 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b0dde10b-84a0-4369-9e38-19ef670baee7 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:15.062162 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b0dde10b-84a0-4369-9e38-19ef670baee7 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:15.065212 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b0dde10b-84a0-4369-9e38-19ef670baee7 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:15.066182 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b0dde10b-84a0-4369-9e38-19ef670baee7 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:15.068613 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b0dde10b-84a0-4369-9e38-19ef670baee7 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:15.071434 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-026b7ec6-08e5-42b2-8b48-dd89a07c7ff4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:15.071977 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-026b7ec6-08e5-42b2-8b48-dd89a07c7ff4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:15.072969 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-026b7ec6-08e5-42b2-8b48-dd89a07c7ff4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:15.075391 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-026b7ec6-08e5-42b2-8b48-dd89a07c7ff4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:15.078597 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-026b7ec6-08e5-42b2-8b48-dd89a07c7ff4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:15.487081 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-b0dde10b-84a0-4369-9e38-19ef670baee7 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:15.491031 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-026b7ec6-08e5-42b2-8b48-dd89a07c7ff4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:15.500903 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-b0dde10b-84a0-4369-9e38-19ef670baee7 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 200 len: 1512 microversion: 2.1 time: 0.458898 Oct 30 00:53:15.505457 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 282/578] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:15 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 1512 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:53:15.507567 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-52a1cf65-c6d2-4575-9cff-5a4691f02164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:15.508213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-52a1cf65-c6d2-4575-9cff-5a4691f02164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:15.511440 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-026b7ec6-08e5-42b2-8b48-dd89a07c7ff4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.473502 Oct 30 00:53:15.512346 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 297/579] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:15 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:15.516648 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-04bc221a-0158-432a-8f2e-f6cb5d488797 req-9a3357ec-24d4-43c7-b066-a03d8d531672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be9e8cf5-e50a-4fab-b8ce-c388caa2223f", "name": "network-vif-deleted", "tag": "7ffb5d5a-9588-4010-90d3-14acde968f35"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:53:15.538661 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-04bc221a-0158-432a-8f2e-f6cb5d488797 req-9a3357ec-24d4-43c7-b066-a03d8d531672 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:15.543942 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-04bc221a-0158-432a-8f2e-f6cb5d488797 req-9a3357ec-24d4-43c7-b066-a03d8d531672 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:15.544603 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-04bc221a-0158-432a-8f2e-f6cb5d488797 req-9a3357ec-24d4-43c7-b066-a03d8d531672 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:15.551264 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-52a1cf65-c6d2-4575-9cff-5a4691f02164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:15.552146 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-52a1cf65-c6d2-4575-9cff-5a4691f02164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:15.555209 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-52a1cf65-c6d2-4575-9cff-5a4691f02164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:15.555990 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-52a1cf65-c6d2-4575-9cff-5a4691f02164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:15.556827 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-52a1cf65-c6d2-4575-9cff-5a4691f02164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:15.557268 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-52a1cf65-c6d2-4575-9cff-5a4691f02164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:15.564029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-04bc221a-0158-432a-8f2e-f6cb5d488797 req-9a3357ec-24d4-43c7-b066-a03d8d531672 service nova] Creating event network-vif-deleted:7ffb5d5a-9588-4010-90d3-14acde968f35 for instance be9e8cf5-e50a-4fab-b8ce-c388caa2223f on hv-cinder-86149 Oct 30 00:53:15.581655 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-04bc221a-0158-432a-8f2e-f6cb5d488797 req-9a3357ec-24d4-43c7-b066-a03d8d531672 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068117 Oct 30 00:53:15.590992 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 298/580] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:53:16.221857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-52a1cf65-c6d2-4575-9cff-5a4691f02164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:16.235544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-52a1cf65-c6d2-4575-9cff-5a4691f02164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:16.237575 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-52a1cf65-c6d2-4575-9cff-5a4691f02164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:16.240391 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-52a1cf65-c6d2-4575-9cff-5a4691f02164 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.737504 Oct 30 00:53:16.240941 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 283/581] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:15 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:16.528764 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ffa9eff4-f05b-4c04-8c4f-9c1e5f26a055 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:16.531572 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ffa9eff4-f05b-4c04-8c4f-9c1e5f26a055 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:16.536882 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3570bc6d-eaa4-444e-888a-821513ad4970 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:16.537808 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-3570bc6d-eaa4-444e-888a-821513ad4970 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:16.545006 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3570bc6d-eaa4-444e-888a-821513ad4970 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:16.545729 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3570bc6d-eaa4-444e-888a-821513ad4970 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:16.546684 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3570bc6d-eaa4-444e-888a-821513ad4970 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:16.547647 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3570bc6d-eaa4-444e-888a-821513ad4970 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:16.548327 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3570bc6d-eaa4-444e-888a-821513ad4970 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:16.549049 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3570bc6d-eaa4-444e-888a-821513ad4970 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:16.552943 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ffa9eff4-f05b-4c04-8c4f-9c1e5f26a055 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:16.553547 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ffa9eff4-f05b-4c04-8c4f-9c1e5f26a055 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:16.554264 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ffa9eff4-f05b-4c04-8c4f-9c1e5f26a055 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:16.555380 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ffa9eff4-f05b-4c04-8c4f-9c1e5f26a055 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:16.556183 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ffa9eff4-f05b-4c04-8c4f-9c1e5f26a055 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:16.556810 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ffa9eff4-f05b-4c04-8c4f-9c1e5f26a055 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:16.602610 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ffa9eff4-f05b-4c04-8c4f-9c1e5f26a055 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:16.603762 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ffa9eff4-f05b-4c04-8c4f-9c1e5f26a055 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:16.604557 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ffa9eff4-f05b-4c04-8c4f-9c1e5f26a055 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:16.605238 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.objects.instance [None req-ffa9eff4-f05b-4c04-8c4f-9c1e5f26a055 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lazy-loading 'fault' on Instance uuid be9e8cf5-e50a-4fab-b8ce-c388caa2223f {{(pid=125554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:53:16.668799 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ffa9eff4-f05b-4c04-8c4f-9c1e5f26a055 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:16.689042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ffa9eff4-f05b-4c04-8c4f-9c1e5f26a055 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 200 len: 1308 microversion: 2.1 time: 0.165337 Oct 30 00:53:16.689975 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 299/582] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:16 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 1308 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:16.826069 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3570bc6d-eaa4-444e-888a-821513ad4970 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:16.843076 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-3570bc6d-eaa4-444e-888a-821513ad4970 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.309791 Oct 30 00:53:16.844062 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 284/583] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:16 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:53:17.266330 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-109f99de-c452-43ca-a4f3-e37baddcd6e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:17.266935 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-109f99de-c452-43ca-a4f3-e37baddcd6e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:17.281242 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-109f99de-c452-43ca-a4f3-e37baddcd6e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:17.282089 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-109f99de-c452-43ca-a4f3-e37baddcd6e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:17.282749 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-109f99de-c452-43ca-a4f3-e37baddcd6e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:17.283660 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-109f99de-c452-43ca-a4f3-e37baddcd6e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:17.289713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-109f99de-c452-43ca-a4f3-e37baddcd6e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:17.290855 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-109f99de-c452-43ca-a4f3-e37baddcd6e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:17.521617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-109f99de-c452-43ca-a4f3-e37baddcd6e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:17.576126 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-109f99de-c452-43ca-a4f3-e37baddcd6e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:17.591774 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-109f99de-c452-43ca-a4f3-e37baddcd6e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:17.591774 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-109f99de-c452-43ca-a4f3-e37baddcd6e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.328785 Oct 30 00:53:17.593023 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 300/584] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:17 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:17.719880 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-aa2032ac-a5e9-4ff0-adcc-cd2f0d76bd1b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:17.720505 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-aa2032ac-a5e9-4ff0-adcc-cd2f0d76bd1b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: be9e8cf5-e50a-4fab-b8ce-c388caa2223f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:17.731020 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aa2032ac-a5e9-4ff0-adcc-cd2f0d76bd1b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:17.731795 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aa2032ac-a5e9-4ff0-adcc-cd2f0d76bd1b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:17.732470 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aa2032ac-a5e9-4ff0-adcc-cd2f0d76bd1b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:17.733359 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aa2032ac-a5e9-4ff0-adcc-cd2f0d76bd1b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:17.733971 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aa2032ac-a5e9-4ff0-adcc-cd2f0d76bd1b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:17.734555 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-aa2032ac-a5e9-4ff0-adcc-cd2f0d76bd1b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:17.751935 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-aa2032ac-a5e9-4ff0-adcc-cd2f0d76bd1b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] HTTP exception thrown: Instance be9e8cf5-e50a-4fab-b8ce-c388caa2223f could not be found. Oct 30 00:53:17.753909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-aa2032ac-a5e9-4ff0-adcc-cd2f0d76bd1b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Request method failure captured: Oct 30 00:53:17.753909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f HTTP/1.1 Oct 30 00:53:17.753909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 00:53:17.753909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 00:53:17.753909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 00:53:17.753909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 00:53:17.753909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 00:53:17.753909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 00:53:17.753909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 00:53:17.753909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 00:53:17.753909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXcqdPoW3kvkIDqmKOnraL5knGL9vGnOOuvhRZW3ELN1zTOyd7h8Kfe2t-Ylf0rkYJiHl4DhX7pVUzzazK-04EeDlloJo6ZVyjlgnW6GGYG0wYS519KEGyPmh6ItdVrdKNPmNhqb4LsVePG6cHGQ-TuGyoQ0t58rmMPQiCOPG-U8-ijU Oct 30 00:53:17.753909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 00:53:17.753909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 00:53:17.753909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 00:53:17.753909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 00:53:17.753909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 00:53:17.753909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 00:53:17.753909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: 68d0e30075684bc9a0d40d779c1ad73f Oct 30 00:53:17.753909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2078867247 Oct 30 00:53:17.753909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 00:53:17.753909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 00:53:17.755516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_68d0e30075684bc9a0d40d779c1ad73f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/68d0e30075684bc9a0d40d779c1ad73f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/68d0e30075684bc9a0d40d779c1ad73f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/68d0e30075684bc9a0d40d779c1ad73f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:53:17.755516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-VolumesSnapshotTestJSON-2078867247 Oct 30 00:53:17.755516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: 68d0e30075684bc9a0d40d779c1ad73f Oct 30 00:53:17.755516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2078867247 Oct 30 00:53:17.755516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-VolumesSnapshotTestJSON-2078867247-project Oct 30 00:53:17.755516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 00:53:17.755516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 00:53:17.755516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: 4b3fa11eb591443e85f7317b6dc9b304 Oct 30 00:53:17.755516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-VolumesSnapshotTestJSON-2078867247-project Oct 30 00:53:17.755516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: > Oct 30 00:53:17.755516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Instance be9e8cf5-e50a-4fab-b8ce-c388caa2223f could not be found. Oct 30 00:53:17.755516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': 'be9e8cf5-e50a-4fab-b8ce-c388caa2223f'} Oct 30 00:53:17.756544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:53:17.756544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:53:17.756544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:53:17.756544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:53:17.756544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:53:17.756544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:53:17.756544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:53:17.756544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:53:17.756544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:53:17.756544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:53:17.756544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be9e8cf5-e50a-4fab-b8ce-c388caa2223f could not be found. Oct 30 00:53:17.756544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:53:17.756544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:53:17.756544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:53:17.756544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:53:17.756544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:53:17.756544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:53:17.756544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:53:17.756544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:53:17.756544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:53:17.758082 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:53:17.758082 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 00:53:17.758082 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 00:53:17.758082 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:53:17.758082 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:53:17.758082 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:53:17.758082 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:53:17.758082 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be9e8cf5-e50a-4fab-b8ce-c388caa2223f could not be found. Oct 30 00:53:17.758082 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:53:17.758082 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:53:17.758082 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:53:17.758082 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:53:17.758082 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:53:17.758082 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:53:17.758082 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:53:17.758082 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:53:17.758082 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be9e8cf5-e50a-4fab-b8ce-c388caa2223f could not be found. Oct 30 00:53:17.758082 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:53:17.760746 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-aa2032ac-a5e9-4ff0-adcc-cd2f0d76bd1b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Returning 404 to user: Instance be9e8cf5-e50a-4fab-b8ce-c388caa2223f could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:53:17.762680 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-aa2032ac-a5e9-4ff0-adcc-cd2f0d76bd1b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f" status: 404 len: 111 microversion: 2.1 time: 0.047446 Oct 30 00:53:17.767506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 285/585] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:17 2022] GET /compute/v2.1/servers/be9e8cf5-e50a-4fab-b8ce-c388caa2223f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 00:53:17.867437 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7c60e7a3-f01d-45a6-a8d2-c527d09fa3c1 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:17.868458 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-7c60e7a3-f01d-45a6-a8d2-c527d09fa3c1 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:17.878463 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7c60e7a3-f01d-45a6-a8d2-c527d09fa3c1 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:17.882917 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7c60e7a3-f01d-45a6-a8d2-c527d09fa3c1 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:17.883675 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7c60e7a3-f01d-45a6-a8d2-c527d09fa3c1 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:17.884683 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7c60e7a3-f01d-45a6-a8d2-c527d09fa3c1 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:17.885351 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7c60e7a3-f01d-45a6-a8d2-c527d09fa3c1 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:17.886007 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7c60e7a3-f01d-45a6-a8d2-c527d09fa3c1 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:18.130277 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7c60e7a3-f01d-45a6-a8d2-c527d09fa3c1 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:18.140434 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7c60e7a3-f01d-45a6-a8d2-c527d09fa3c1 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.277340 Oct 30 00:53:18.148926 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 301/586] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:17 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:18.634175 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3243a3f8-83d1-491a-89b8-78d6a3f8b935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:18.634793 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-3243a3f8-83d1-491a-89b8-78d6a3f8b935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:18.644216 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3243a3f8-83d1-491a-89b8-78d6a3f8b935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:18.644763 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3243a3f8-83d1-491a-89b8-78d6a3f8b935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:18.645202 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3243a3f8-83d1-491a-89b8-78d6a3f8b935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:18.646526 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3243a3f8-83d1-491a-89b8-78d6a3f8b935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:18.647169 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3243a3f8-83d1-491a-89b8-78d6a3f8b935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:18.647621 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3243a3f8-83d1-491a-89b8-78d6a3f8b935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:18.794976 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3243a3f8-83d1-491a-89b8-78d6a3f8b935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:18.806199 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3243a3f8-83d1-491a-89b8-78d6a3f8b935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:18.808022 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3243a3f8-83d1-491a-89b8-78d6a3f8b935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:18.809340 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-3243a3f8-83d1-491a-89b8-78d6a3f8b935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.180358 Oct 30 00:53:18.817211 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 286/587] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:18 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:19.173147 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-70ba01d0-279e-475c-889d-be36d8cd47a4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:19.174401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-70ba01d0-279e-475c-889d-be36d8cd47a4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:19.182118 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-70ba01d0-279e-475c-889d-be36d8cd47a4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:19.182872 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-70ba01d0-279e-475c-889d-be36d8cd47a4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:19.183478 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-70ba01d0-279e-475c-889d-be36d8cd47a4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:19.184365 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-70ba01d0-279e-475c-889d-be36d8cd47a4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:19.184965 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-70ba01d0-279e-475c-889d-be36d8cd47a4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:19.185539 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-70ba01d0-279e-475c-889d-be36d8cd47a4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:19.388668 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-70ba01d0-279e-475c-889d-be36d8cd47a4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:19.399696 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-70ba01d0-279e-475c-889d-be36d8cd47a4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.238873 Oct 30 00:53:19.413173 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 302/588] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:19 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:19.835896 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-6befee27-c424-4b17-af83-625ac143a9cd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:19.836633 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-6befee27-c424-4b17-af83-625ac143a9cd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:19.844651 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6befee27-c424-4b17-af83-625ac143a9cd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:19.845866 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6befee27-c424-4b17-af83-625ac143a9cd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:19.846740 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6befee27-c424-4b17-af83-625ac143a9cd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:19.847977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6befee27-c424-4b17-af83-625ac143a9cd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:19.848532 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6befee27-c424-4b17-af83-625ac143a9cd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:19.848960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6befee27-c424-4b17-af83-625ac143a9cd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:19.852091 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:20.012314 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-6befee27-c424-4b17-af83-625ac143a9cd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:20.024062 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-6befee27-c424-4b17-af83-625ac143a9cd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:20.025539 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-6befee27-c424-4b17-af83-625ac143a9cd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:20.026778 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-6befee27-c424-4b17-af83-625ac143a9cd tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.195594 Oct 30 00:53:20.040527 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 287/589] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:19 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:20.475538 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-abdbddf1-0582-4d9f-a62e-2457f5b3fa88 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:20.477066 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-abdbddf1-0582-4d9f-a62e-2457f5b3fa88 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:20.490425 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-abdbddf1-0582-4d9f-a62e-2457f5b3fa88 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:20.491436 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-abdbddf1-0582-4d9f-a62e-2457f5b3fa88 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:20.492338 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-abdbddf1-0582-4d9f-a62e-2457f5b3fa88 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:20.493568 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-abdbddf1-0582-4d9f-a62e-2457f5b3fa88 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:20.494677 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-abdbddf1-0582-4d9f-a62e-2457f5b3fa88 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:20.495339 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-abdbddf1-0582-4d9f-a62e-2457f5b3fa88 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:20.712470 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-abdbddf1-0582-4d9f-a62e-2457f5b3fa88 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:20.725949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-abdbddf1-0582-4d9f-a62e-2457f5b3fa88 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.300796 Oct 30 00:53:20.727610 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 303/590] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:20 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:21.052549 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-ecc66345-a001-450b-8891-5421dfefba2a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:21.053801 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-ecc66345-a001-450b-8891-5421dfefba2a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:21.069972 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ecc66345-a001-450b-8891-5421dfefba2a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:21.070472 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ecc66345-a001-450b-8891-5421dfefba2a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:21.071164 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ecc66345-a001-450b-8891-5421dfefba2a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:21.071876 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ecc66345-a001-450b-8891-5421dfefba2a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:21.072965 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ecc66345-a001-450b-8891-5421dfefba2a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:21.072965 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ecc66345-a001-450b-8891-5421dfefba2a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:21.321437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ecc66345-a001-450b-8891-5421dfefba2a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:21.330744 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ecc66345-a001-450b-8891-5421dfefba2a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:21.332768 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ecc66345-a001-450b-8891-5421dfefba2a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:21.334043 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-ecc66345-a001-450b-8891-5421dfefba2a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.286070 Oct 30 00:53:21.335120 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 288/591] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:21 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:21.772888 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-931a4ef7-3f08-43a8-9c4c-26e23ab994c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:21.775308 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-931a4ef7-3f08-43a8-9c4c-26e23ab994c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:21.783242 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-931a4ef7-3f08-43a8-9c4c-26e23ab994c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:21.783724 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-931a4ef7-3f08-43a8-9c4c-26e23ab994c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:21.784214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-931a4ef7-3f08-43a8-9c4c-26e23ab994c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:21.784888 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-931a4ef7-3f08-43a8-9c4c-26e23ab994c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:21.785420 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-931a4ef7-3f08-43a8-9c4c-26e23ab994c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:21.787299 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-931a4ef7-3f08-43a8-9c4c-26e23ab994c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:21.998124 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-931a4ef7-3f08-43a8-9c4c-26e23ab994c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:22.010379 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-931a4ef7-3f08-43a8-9c4c-26e23ab994c2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.261634 Oct 30 00:53:22.012279 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 304/592] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:21 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:22.360613 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-fa682413-9a49-460b-8866-291494bbb6b2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:22.362015 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-fa682413-9a49-460b-8866-291494bbb6b2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:22.366384 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:22.370973 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fa682413-9a49-460b-8866-291494bbb6b2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:22.371541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fa682413-9a49-460b-8866-291494bbb6b2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:22.372034 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fa682413-9a49-460b-8866-291494bbb6b2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:22.372815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fa682413-9a49-460b-8866-291494bbb6b2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:22.373498 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fa682413-9a49-460b-8866-291494bbb6b2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:22.374082 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fa682413-9a49-460b-8866-291494bbb6b2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:22.526808 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fa682413-9a49-460b-8866-291494bbb6b2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:22.537429 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fa682413-9a49-460b-8866-291494bbb6b2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:22.538930 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fa682413-9a49-460b-8866-291494bbb6b2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:22.540126 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-fa682413-9a49-460b-8866-291494bbb6b2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.183448 Oct 30 00:53:22.544112 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 289/593] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:22 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:23.040008 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-9a7016ac-e333-4cc9-b7b0-12c0480c258e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:23.041401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-9a7016ac-e333-4cc9-b7b0-12c0480c258e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:23.051227 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9a7016ac-e333-4cc9-b7b0-12c0480c258e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:23.052114 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9a7016ac-e333-4cc9-b7b0-12c0480c258e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:23.052774 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9a7016ac-e333-4cc9-b7b0-12c0480c258e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:23.053556 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9a7016ac-e333-4cc9-b7b0-12c0480c258e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:23.054081 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9a7016ac-e333-4cc9-b7b0-12c0480c258e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:23.054586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9a7016ac-e333-4cc9-b7b0-12c0480c258e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:23.239682 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9a7016ac-e333-4cc9-b7b0-12c0480c258e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:23.257916 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-9a7016ac-e333-4cc9-b7b0-12c0480c258e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.214206 Oct 30 00:53:23.258815 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 305/594] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:23 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:23.567163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f6565618-511d-48b4-adab-c79bdceb41ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:23.568068 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f6565618-511d-48b4-adab-c79bdceb41ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:23.579685 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6565618-511d-48b4-adab-c79bdceb41ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:23.580249 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6565618-511d-48b4-adab-c79bdceb41ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:23.580694 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6565618-511d-48b4-adab-c79bdceb41ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:23.581409 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6565618-511d-48b4-adab-c79bdceb41ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:23.581863 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6565618-511d-48b4-adab-c79bdceb41ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:23.582816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f6565618-511d-48b4-adab-c79bdceb41ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:23.775060 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f6565618-511d-48b4-adab-c79bdceb41ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:23.787888 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f6565618-511d-48b4-adab-c79bdceb41ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:23.789458 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f6565618-511d-48b4-adab-c79bdceb41ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:23.790655 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f6565618-511d-48b4-adab-c79bdceb41ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.227653 Oct 30 00:53:23.806712 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 290/595] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:23 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:24.287192 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b0ee464d-f8b2-4c22-982e-e6b922f0fd30 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:24.287811 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-b0ee464d-f8b2-4c22-982e-e6b922f0fd30 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:24.294869 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b0ee464d-f8b2-4c22-982e-e6b922f0fd30 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:24.295390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b0ee464d-f8b2-4c22-982e-e6b922f0fd30 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:24.295823 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b0ee464d-f8b2-4c22-982e-e6b922f0fd30 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:24.296558 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b0ee464d-f8b2-4c22-982e-e6b922f0fd30 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:24.297027 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b0ee464d-f8b2-4c22-982e-e6b922f0fd30 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:24.297424 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b0ee464d-f8b2-4c22-982e-e6b922f0fd30 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:24.303421 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:24.443449 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b0ee464d-f8b2-4c22-982e-e6b922f0fd30 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:24.455990 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b0ee464d-f8b2-4c22-982e-e6b922f0fd30 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.172954 Oct 30 00:53:24.456821 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 306/596] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:24 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:24.822672 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5dfa4c9e-1960-42b7-96c4-413aecc62482 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:24.823239 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5dfa4c9e-1960-42b7-96c4-413aecc62482 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:24.829631 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5dfa4c9e-1960-42b7-96c4-413aecc62482 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:24.830326 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5dfa4c9e-1960-42b7-96c4-413aecc62482 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:24.830937 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5dfa4c9e-1960-42b7-96c4-413aecc62482 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:24.831637 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5dfa4c9e-1960-42b7-96c4-413aecc62482 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:24.832435 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5dfa4c9e-1960-42b7-96c4-413aecc62482 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:24.833238 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5dfa4c9e-1960-42b7-96c4-413aecc62482 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:25.025637 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5dfa4c9e-1960-42b7-96c4-413aecc62482 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:25.034923 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5dfa4c9e-1960-42b7-96c4-413aecc62482 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:25.037909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5dfa4c9e-1960-42b7-96c4-413aecc62482 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:25.039489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5dfa4c9e-1960-42b7-96c4-413aecc62482 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.221826 Oct 30 00:53:25.052177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 291/597] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:24 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:25.484791 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-14ac454f-b2a5-425a-b806-e43c9af04314 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:25.485400 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-14ac454f-b2a5-425a-b806-e43c9af04314 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:25.492772 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-14ac454f-b2a5-425a-b806-e43c9af04314 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:25.493257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-14ac454f-b2a5-425a-b806-e43c9af04314 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:25.493691 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-14ac454f-b2a5-425a-b806-e43c9af04314 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:25.494415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-14ac454f-b2a5-425a-b806-e43c9af04314 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:25.495090 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-14ac454f-b2a5-425a-b806-e43c9af04314 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:25.495586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-14ac454f-b2a5-425a-b806-e43c9af04314 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:25.625632 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-14ac454f-b2a5-425a-b806-e43c9af04314 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:25.634868 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-14ac454f-b2a5-425a-b806-e43c9af04314 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.154686 Oct 30 00:53:25.635424 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 307/598] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:25 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:53:26.066395 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-7dc9c91b-db3e-466e-a966-f10c8c24a157 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:26.067863 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-7dc9c91b-db3e-466e-a966-f10c8c24a157 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:26.075506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7dc9c91b-db3e-466e-a966-f10c8c24a157 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:26.075980 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7dc9c91b-db3e-466e-a966-f10c8c24a157 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:26.076441 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7dc9c91b-db3e-466e-a966-f10c8c24a157 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:26.077205 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7dc9c91b-db3e-466e-a966-f10c8c24a157 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:26.077654 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7dc9c91b-db3e-466e-a966-f10c8c24a157 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:26.078069 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7dc9c91b-db3e-466e-a966-f10c8c24a157 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:26.206589 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-7dc9c91b-db3e-466e-a966-f10c8c24a157 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:26.216701 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-7dc9c91b-db3e-466e-a966-f10c8c24a157 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:26.218125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-7dc9c91b-db3e-466e-a966-f10c8c24a157 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:26.219262 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-7dc9c91b-db3e-466e-a966-f10c8c24a157 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.157480 Oct 30 00:53:26.219798 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 292/599] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:26 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:26.658768 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-cc3471c1-c3e2-475b-ad9a-ac309dcd90fb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:26.659368 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-cc3471c1-c3e2-475b-ad9a-ac309dcd90fb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:26.665960 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cc3471c1-c3e2-475b-ad9a-ac309dcd90fb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:26.666386 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cc3471c1-c3e2-475b-ad9a-ac309dcd90fb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:26.666951 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cc3471c1-c3e2-475b-ad9a-ac309dcd90fb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:26.667534 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cc3471c1-c3e2-475b-ad9a-ac309dcd90fb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:26.668279 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cc3471c1-c3e2-475b-ad9a-ac309dcd90fb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:26.668487 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cc3471c1-c3e2-475b-ad9a-ac309dcd90fb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:26.808482 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-cc3471c1-c3e2-475b-ad9a-ac309dcd90fb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:26.818211 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-cc3471c1-c3e2-475b-ad9a-ac309dcd90fb tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.161694 Oct 30 00:53:26.818794 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 308/600] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:26 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:27.246166 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-97e66a8e-494f-4cf2-b570-c6248fca998b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:27.246686 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-97e66a8e-494f-4cf2-b570-c6248fca998b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:27.253578 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-97e66a8e-494f-4cf2-b570-c6248fca998b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:27.253982 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-97e66a8e-494f-4cf2-b570-c6248fca998b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:27.254416 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-97e66a8e-494f-4cf2-b570-c6248fca998b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:27.255846 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-97e66a8e-494f-4cf2-b570-c6248fca998b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:27.256322 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-97e66a8e-494f-4cf2-b570-c6248fca998b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:27.256743 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-97e66a8e-494f-4cf2-b570-c6248fca998b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:27.394010 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-97e66a8e-494f-4cf2-b570-c6248fca998b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:27.404016 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-97e66a8e-494f-4cf2-b570-c6248fca998b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:27.405826 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-97e66a8e-494f-4cf2-b570-c6248fca998b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:27.406682 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-97e66a8e-494f-4cf2-b570-c6248fca998b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.164473 Oct 30 00:53:27.407211 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 293/601] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:27 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:27.842923 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ec551677-ecbd-4df1-8430-34f5da6daf94 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:27.843540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ec551677-ecbd-4df1-8430-34f5da6daf94 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:27.850870 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ec551677-ecbd-4df1-8430-34f5da6daf94 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:27.851809 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ec551677-ecbd-4df1-8430-34f5da6daf94 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:27.852297 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ec551677-ecbd-4df1-8430-34f5da6daf94 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:27.852999 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ec551677-ecbd-4df1-8430-34f5da6daf94 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:27.853457 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ec551677-ecbd-4df1-8430-34f5da6daf94 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:27.853884 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ec551677-ecbd-4df1-8430-34f5da6daf94 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:28.009729 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ec551677-ecbd-4df1-8430-34f5da6daf94 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:28.019407 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ec551677-ecbd-4df1-8430-34f5da6daf94 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.180393 Oct 30 00:53:28.020931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 309/602] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:27 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:28.433590 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-fce96d7a-39c5-4d2c-81e1-b0c47e08439a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:28.434215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-fce96d7a-39c5-4d2c-81e1-b0c47e08439a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:28.441344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fce96d7a-39c5-4d2c-81e1-b0c47e08439a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:28.442285 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fce96d7a-39c5-4d2c-81e1-b0c47e08439a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:28.442880 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fce96d7a-39c5-4d2c-81e1-b0c47e08439a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:28.443762 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fce96d7a-39c5-4d2c-81e1-b0c47e08439a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:28.444352 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fce96d7a-39c5-4d2c-81e1-b0c47e08439a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:28.445068 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fce96d7a-39c5-4d2c-81e1-b0c47e08439a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:28.603042 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fce96d7a-39c5-4d2c-81e1-b0c47e08439a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:28.611454 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fce96d7a-39c5-4d2c-81e1-b0c47e08439a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:28.612899 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fce96d7a-39c5-4d2c-81e1-b0c47e08439a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:28.614603 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-fce96d7a-39c5-4d2c-81e1-b0c47e08439a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.184565 Oct 30 00:53:28.615152 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 294/603] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:28 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:29.162713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-259c507f-6252-4c89-9ac4-5481b64316f2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:29.163324 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-259c507f-6252-4c89-9ac4-5481b64316f2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:29.169327 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-259c507f-6252-4c89-9ac4-5481b64316f2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:29.169804 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-259c507f-6252-4c89-9ac4-5481b64316f2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:29.170238 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-259c507f-6252-4c89-9ac4-5481b64316f2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:29.170931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-259c507f-6252-4c89-9ac4-5481b64316f2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:29.171383 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-259c507f-6252-4c89-9ac4-5481b64316f2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:29.171806 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-259c507f-6252-4c89-9ac4-5481b64316f2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:29.307254 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-259c507f-6252-4c89-9ac4-5481b64316f2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:29.315413 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-259c507f-6252-4c89-9ac4-5481b64316f2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.272537 Oct 30 00:53:29.315985 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 310/604] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:29 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:29.640732 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-10e7bd3d-81df-4e79-b07f-7eac185a9765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:29.641360 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-10e7bd3d-81df-4e79-b07f-7eac185a9765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:29.648185 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-10e7bd3d-81df-4e79-b07f-7eac185a9765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:29.648676 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-10e7bd3d-81df-4e79-b07f-7eac185a9765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:29.649111 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-10e7bd3d-81df-4e79-b07f-7eac185a9765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:29.649821 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-10e7bd3d-81df-4e79-b07f-7eac185a9765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:29.650267 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-10e7bd3d-81df-4e79-b07f-7eac185a9765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:29.650689 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-10e7bd3d-81df-4e79-b07f-7eac185a9765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:29.805460 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-10e7bd3d-81df-4e79-b07f-7eac185a9765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:29.814551 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-10e7bd3d-81df-4e79-b07f-7eac185a9765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:29.815993 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-10e7bd3d-81df-4e79-b07f-7eac185a9765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:29.817973 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-10e7bd3d-81df-4e79-b07f-7eac185a9765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.181158 Oct 30 00:53:29.832242 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 295/605] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:29 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:30.339901 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-9c37b89d-7376-41ca-b720-e9618ba0440e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:30.340740 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-9c37b89d-7376-41ca-b720-e9618ba0440e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:30.349086 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9c37b89d-7376-41ca-b720-e9618ba0440e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:30.349939 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9c37b89d-7376-41ca-b720-e9618ba0440e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:30.350601 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9c37b89d-7376-41ca-b720-e9618ba0440e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:30.351409 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9c37b89d-7376-41ca-b720-e9618ba0440e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:30.352009 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9c37b89d-7376-41ca-b720-e9618ba0440e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:30.352710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9c37b89d-7376-41ca-b720-e9618ba0440e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:30.558736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9c37b89d-7376-41ca-b720-e9618ba0440e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:30.570582 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-9c37b89d-7376-41ca-b720-e9618ba0440e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.234508 Oct 30 00:53:30.571415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 311/606] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:30 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:30.843786 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a679a317-dfc2-464b-bb6a-afb105dfcda2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:30.845083 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a679a317-dfc2-464b-bb6a-afb105dfcda2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:30.851732 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a679a317-dfc2-464b-bb6a-afb105dfcda2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:30.852234 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a679a317-dfc2-464b-bb6a-afb105dfcda2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:30.852661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a679a317-dfc2-464b-bb6a-afb105dfcda2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:30.853347 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a679a317-dfc2-464b-bb6a-afb105dfcda2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:30.853796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a679a317-dfc2-464b-bb6a-afb105dfcda2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:30.854213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a679a317-dfc2-464b-bb6a-afb105dfcda2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:30.999776 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a679a317-dfc2-464b-bb6a-afb105dfcda2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:31.009648 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a679a317-dfc2-464b-bb6a-afb105dfcda2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:31.011089 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a679a317-dfc2-464b-bb6a-afb105dfcda2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:31.012752 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a679a317-dfc2-464b-bb6a-afb105dfcda2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.172276 Oct 30 00:53:31.013311 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 296/607] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:30 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:31.594547 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f90b8a19-1950-495f-84a9-f40dca40c2d5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:31.595151 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-f90b8a19-1950-495f-84a9-f40dca40c2d5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:31.602174 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f90b8a19-1950-495f-84a9-f40dca40c2d5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:31.602653 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f90b8a19-1950-495f-84a9-f40dca40c2d5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:31.603084 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f90b8a19-1950-495f-84a9-f40dca40c2d5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:31.603767 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f90b8a19-1950-495f-84a9-f40dca40c2d5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:31.604240 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f90b8a19-1950-495f-84a9-f40dca40c2d5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:31.604659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f90b8a19-1950-495f-84a9-f40dca40c2d5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:31.730935 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-f90b8a19-1950-495f-84a9-f40dca40c2d5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:31.739708 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-f90b8a19-1950-495f-84a9-f40dca40c2d5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.148318 Oct 30 00:53:31.740299 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 312/608] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:31 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:32.040393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a04d0c2b-c086-4297-9834-f3e8325c80ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:32.041124 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a04d0c2b-c086-4297-9834-f3e8325c80ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:32.047679 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a04d0c2b-c086-4297-9834-f3e8325c80ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:32.048187 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a04d0c2b-c086-4297-9834-f3e8325c80ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:32.048617 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a04d0c2b-c086-4297-9834-f3e8325c80ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:32.049809 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a04d0c2b-c086-4297-9834-f3e8325c80ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:32.050259 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a04d0c2b-c086-4297-9834-f3e8325c80ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:32.050676 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a04d0c2b-c086-4297-9834-f3e8325c80ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:32.184786 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a04d0c2b-c086-4297-9834-f3e8325c80ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:32.194197 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a04d0c2b-c086-4297-9834-f3e8325c80ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:32.195678 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a04d0c2b-c086-4297-9834-f3e8325c80ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:32.197372 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a04d0c2b-c086-4297-9834-f3e8325c80ff tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.162384 Oct 30 00:53:32.197918 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 297/609] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:32 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:32.763101 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-95920c54-df78-4a1b-b45a-066f3dd57b37 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:32.763645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-95920c54-df78-4a1b-b45a-066f3dd57b37 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:32.770144 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-95920c54-df78-4a1b-b45a-066f3dd57b37 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:32.770666 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-95920c54-df78-4a1b-b45a-066f3dd57b37 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:32.771095 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-95920c54-df78-4a1b-b45a-066f3dd57b37 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:32.771789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-95920c54-df78-4a1b-b45a-066f3dd57b37 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:32.772322 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-95920c54-df78-4a1b-b45a-066f3dd57b37 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:32.772738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-95920c54-df78-4a1b-b45a-066f3dd57b37 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:32.903463 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-95920c54-df78-4a1b-b45a-066f3dd57b37 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:32.911738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-95920c54-df78-4a1b-b45a-066f3dd57b37 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.152634 Oct 30 00:53:32.912317 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 313/610] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:32 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:33.229021 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-b737f5f2-0fb6-43bd-adf0-a4ad0055383a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:33.229637 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-b737f5f2-0fb6-43bd-adf0-a4ad0055383a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:33.236072 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b737f5f2-0fb6-43bd-adf0-a4ad0055383a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:33.236578 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b737f5f2-0fb6-43bd-adf0-a4ad0055383a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:33.237011 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b737f5f2-0fb6-43bd-adf0-a4ad0055383a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:33.237696 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b737f5f2-0fb6-43bd-adf0-a4ad0055383a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:33.238144 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b737f5f2-0fb6-43bd-adf0-a4ad0055383a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:33.238564 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b737f5f2-0fb6-43bd-adf0-a4ad0055383a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:33.367975 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-b737f5f2-0fb6-43bd-adf0-a4ad0055383a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:33.376916 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-b737f5f2-0fb6-43bd-adf0-a4ad0055383a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:33.378356 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-b737f5f2-0fb6-43bd-adf0-a4ad0055383a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:33.380195 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-b737f5f2-0fb6-43bd-adf0-a4ad0055383a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.154423 Oct 30 00:53:33.380764 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 298/611] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:33 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:53:33.935212 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-e6e66cff-8262-408b-826d-576aa3dab871 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:33.935828 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-e6e66cff-8262-408b-826d-576aa3dab871 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:33.942782 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e6e66cff-8262-408b-826d-576aa3dab871 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:33.943256 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e6e66cff-8262-408b-826d-576aa3dab871 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:33.943682 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e6e66cff-8262-408b-826d-576aa3dab871 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:33.944386 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e6e66cff-8262-408b-826d-576aa3dab871 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:33.944828 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e6e66cff-8262-408b-826d-576aa3dab871 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:33.945259 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e6e66cff-8262-408b-826d-576aa3dab871 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:34.082901 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e6e66cff-8262-408b-826d-576aa3dab871 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:34.091025 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-e6e66cff-8262-408b-826d-576aa3dab871 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.159628 Oct 30 00:53:34.091579 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 314/612] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:33 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:34.405111 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-ead68392-d54b-415d-b798-b85c22373246 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:34.405703 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-ead68392-d54b-415d-b798-b85c22373246 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:34.412902 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ead68392-d54b-415d-b798-b85c22373246 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:34.413388 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ead68392-d54b-415d-b798-b85c22373246 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:34.413825 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ead68392-d54b-415d-b798-b85c22373246 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:34.414517 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ead68392-d54b-415d-b798-b85c22373246 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:34.414968 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ead68392-d54b-415d-b798-b85c22373246 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:34.415394 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ead68392-d54b-415d-b798-b85c22373246 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:34.542236 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ead68392-d54b-415d-b798-b85c22373246 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:34.550646 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ead68392-d54b-415d-b798-b85c22373246 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:34.552346 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ead68392-d54b-415d-b798-b85c22373246 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:34.553499 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-ead68392-d54b-415d-b798-b85c22373246 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.152251 Oct 30 00:53:34.554048 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 299/613] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:34 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:53:35.115130 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-6ee1989e-7c8b-4d26-aa73-147b77497ccc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:35.115726 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-6ee1989e-7c8b-4d26-aa73-147b77497ccc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:35.122072 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6ee1989e-7c8b-4d26-aa73-147b77497ccc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:35.122542 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6ee1989e-7c8b-4d26-aa73-147b77497ccc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:35.122967 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6ee1989e-7c8b-4d26-aa73-147b77497ccc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:35.123637 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6ee1989e-7c8b-4d26-aa73-147b77497ccc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:35.124106 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6ee1989e-7c8b-4d26-aa73-147b77497ccc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:35.124520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6ee1989e-7c8b-4d26-aa73-147b77497ccc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:35.260253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6ee1989e-7c8b-4d26-aa73-147b77497ccc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:35.269380 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-6ee1989e-7c8b-4d26-aa73-147b77497ccc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1723 microversion: 2.1 time: 0.158938 Oct 30 00:53:35.269944 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 315/614] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:35 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:35.579809 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-8e2e7126-4fb0-4c5b-8a8b-d429ec0cf17a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:35.580439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-8e2e7126-4fb0-4c5b-8a8b-d429ec0cf17a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:35.587142 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8e2e7126-4fb0-4c5b-8a8b-d429ec0cf17a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:35.587620 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8e2e7126-4fb0-4c5b-8a8b-d429ec0cf17a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:35.588051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8e2e7126-4fb0-4c5b-8a8b-d429ec0cf17a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:35.588756 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8e2e7126-4fb0-4c5b-8a8b-d429ec0cf17a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:35.589207 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8e2e7126-4fb0-4c5b-8a8b-d429ec0cf17a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:35.589627 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8e2e7126-4fb0-4c5b-8a8b-d429ec0cf17a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:35.716893 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8e2e7126-4fb0-4c5b-8a8b-d429ec0cf17a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:35.725796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8e2e7126-4fb0-4c5b-8a8b-d429ec0cf17a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:35.727240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8e2e7126-4fb0-4c5b-8a8b-d429ec0cf17a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:35.728467 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-8e2e7126-4fb0-4c5b-8a8b-d429ec0cf17a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.152490 Oct 30 00:53:35.729017 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 300/615] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:35 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:36.212316 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-468c48a9-0285-4c81-80af-b70e25af54ed tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1239080121", "imageRef": "27983dee-4bd6-4aad-9c28-22bd5382709a", "flavorRef": "452", "networks": [{"uuid": "caee7172-f4a0-4049-8fe3-0d4fd05999a0"}]}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:53:36.266287 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.network.neutron [None req-468c48a9-0285-4c81-80af-b70e25af54ed tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] validate_networks() for [('caee7172-f4a0-4049-8fe3-0d4fd05999a0', None, None, None, None, None)] {{(pid=125554) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 00:53:36.294524 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-9810c57d-2015-4a21-bace-2c4820e3a481 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:36.295129 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-9810c57d-2015-4a21-bace-2c4820e3a481 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:36.301044 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9810c57d-2015-4a21-bace-2c4820e3a481 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:36.302142 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9810c57d-2015-4a21-bace-2c4820e3a481 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:36.302608 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9810c57d-2015-4a21-bace-2c4820e3a481 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:36.303371 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9810c57d-2015-4a21-bace-2c4820e3a481 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:36.303826 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9810c57d-2015-4a21-bace-2c4820e3a481 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:36.304279 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9810c57d-2015-4a21-bace-2c4820e3a481 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:36.496435 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-9810c57d-2015-4a21-bace-2c4820e3a481 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:36.504680 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-9810c57d-2015-4a21-bace-2c4820e3a481 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1700 microversion: 2.1 time: 0.213807 Oct 30 00:53:36.505177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 301/616] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:36 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1700 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:53:36.529302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-963ea3ba-3acb-46f2-bf05-6ddaf093546b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:53:36.535098 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-963ea3ba-3acb-46f2-bf05-6ddaf093546b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:36.535586 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-963ea3ba-3acb-46f2-bf05-6ddaf093546b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:36.536647 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-963ea3ba-3acb-46f2-bf05-6ddaf093546b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:36.558570 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-963ea3ba-3acb-46f2-bf05-6ddaf093546b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Going to try to start instance {{(pid=125553) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 30 00:53:36.595704 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:36.603992 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-963ea3ba-3acb-46f2-bf05-6ddaf093546b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "POST /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26/action" status: 202 len: 0 microversion: 2.1 time: 0.078331 Oct 30 00:53:36.604837 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 302/617] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Oct 30 00:53:36 2022] POST /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 00:53:36.612981 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-fb963ef0-b5c4-482f-be4d-5b3e414b19f3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:36.613773 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-fb963ef0-b5c4-482f-be4d-5b3e414b19f3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:36.621395 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb963ef0-b5c4-482f-be4d-5b3e414b19f3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:36.621817 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb963ef0-b5c4-482f-be4d-5b3e414b19f3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:36.622254 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb963ef0-b5c4-482f-be4d-5b3e414b19f3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:36.622948 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb963ef0-b5c4-482f-be4d-5b3e414b19f3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:36.623414 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb963ef0-b5c4-482f-be4d-5b3e414b19f3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:36.623824 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fb963ef0-b5c4-482f-be4d-5b3e414b19f3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:36.726788 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-468c48a9-0285-4c81-80af-b70e25af54ed tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Flavor limits 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 00:53:36.727209 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-468c48a9-0285-4c81-80af-b70e25af54ed tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Image limits 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 00:53:36.727700 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-468c48a9-0285-4c81-80af-b70e25af54ed tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Flavor pref 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 00:53:36.728265 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-468c48a9-0285-4c81-80af-b70e25af54ed tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Image pref 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 00:53:36.728672 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-468c48a9-0285-4c81-80af-b70e25af54ed tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 00:53:36.738163 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-468c48a9-0285-4c81-80af-b70e25af54ed tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:36.738635 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-468c48a9-0285-4c81-80af-b70e25af54ed tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:36.739099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-468c48a9-0285-4c81-80af-b70e25af54ed tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:36.740350 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-468c48a9-0285-4c81-80af-b70e25af54ed tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:36.740792 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-468c48a9-0285-4c81-80af-b70e25af54ed tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:36.741207 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-468c48a9-0285-4c81-80af-b70e25af54ed tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:36.758179 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-468c48a9-0285-4c81-80af-b70e25af54ed tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Getting quotas for project 68d0e30075684bc9a0d40d779c1ad73f. Resources: {'instances', 'cores', 'ram'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 00:53:36.762526 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-468c48a9-0285-4c81-80af-b70e25af54ed tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Getting quotas for user 4b3fa11eb591443e85f7317b6dc9b304 and project 68d0e30075684bc9a0d40d779c1ad73f. Resources: {'instances', 'cores', 'ram'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 00:53:36.773184 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fb963ef0-b5c4-482f-be4d-5b3e414b19f3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:36.774224 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-468c48a9-0285-4c81-80af-b70e25af54ed tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Going to run 1 instances... {{(pid=125554) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 00:53:36.776567 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-468c48a9-0285-4c81-80af-b70e25af54ed tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27983dee-4bd6-4aad-9c28-22bd5382709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125554) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 00:53:36.782094 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-fb963ef0-b5c4-482f-be4d-5b3e414b19f3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1709 microversion: 2.1 time: 0.172937 Oct 30 00:53:36.782877 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 303/618] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:36 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1709 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:53:36.789068 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-16b2269a-ec65-483d-aa52-35be5ba01cab tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:36.789068 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-16b2269a-ec65-483d-aa52-35be5ba01cab tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:36.795649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-16b2269a-ec65-483d-aa52-35be5ba01cab tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:36.796437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-16b2269a-ec65-483d-aa52-35be5ba01cab tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:36.797044 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-16b2269a-ec65-483d-aa52-35be5ba01cab tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:36.798072 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-16b2269a-ec65-483d-aa52-35be5ba01cab tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:36.798813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-16b2269a-ec65-483d-aa52-35be5ba01cab tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:36.799477 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-16b2269a-ec65-483d-aa52-35be5ba01cab tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:36.834645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-468c48a9-0285-4c81-80af-b70e25af54ed tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626156 Oct 30 00:53:36.835676 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 316/619] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Oct 30 00:53:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 00:53:36.847565 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-87269cc2-9fc8-4de2-a6d9-6f968d376bfe tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:36.850246 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-87269cc2-9fc8-4de2-a6d9-6f968d376bfe tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:36.933513 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-87269cc2-9fc8-4de2-a6d9-6f968d376bfe tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:36.941122 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-87269cc2-9fc8-4de2-a6d9-6f968d376bfe tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17" status: 200 len: 1219 microversion: 2.1 time: 0.098312 Oct 30 00:53:36.943655 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 317/620] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:36 2022] GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:36.948058 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-42cf42f3-52cd-4f9d-86a0-2ecbfea6b21d tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-721243837", "imageRef": "27983dee-4bd6-4aad-9c28-22bd5382709a", "flavorRef": "452"}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:53:36.968570 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-16b2269a-ec65-483d-aa52-35be5ba01cab tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:36.997631 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-16b2269a-ec65-483d-aa52-35be5ba01cab tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:36.999652 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-16b2269a-ec65-483d-aa52-35be5ba01cab tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:37.001047 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-16b2269a-ec65-483d-aa52-35be5ba01cab tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.217180 Oct 30 00:53:37.001827 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 304/621] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:36 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:37.009650 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.network.neutron [None req-42cf42f3-52cd-4f9d-86a0-2ecbfea6b21d tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] validate_networks() for None {{(pid=125554) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 00:53:37.449625 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-42cf42f3-52cd-4f9d-86a0-2ecbfea6b21d tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Flavor limits 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 00:53:37.450229 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-42cf42f3-52cd-4f9d-86a0-2ecbfea6b21d tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Image limits 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 00:53:37.450484 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-42cf42f3-52cd-4f9d-86a0-2ecbfea6b21d tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Flavor pref 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 00:53:37.450881 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-42cf42f3-52cd-4f9d-86a0-2ecbfea6b21d tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Image pref 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 00:53:37.451282 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-42cf42f3-52cd-4f9d-86a0-2ecbfea6b21d tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 00:53:37.461282 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-42cf42f3-52cd-4f9d-86a0-2ecbfea6b21d tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:37.461764 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-42cf42f3-52cd-4f9d-86a0-2ecbfea6b21d tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:37.462194 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-42cf42f3-52cd-4f9d-86a0-2ecbfea6b21d tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:37.462909 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-42cf42f3-52cd-4f9d-86a0-2ecbfea6b21d tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:37.463359 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-42cf42f3-52cd-4f9d-86a0-2ecbfea6b21d tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:37.463782 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-42cf42f3-52cd-4f9d-86a0-2ecbfea6b21d tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:37.482204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-42cf42f3-52cd-4f9d-86a0-2ecbfea6b21d tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Getting quotas for project 12b6e06859f24f798b222c646238b39d. Resources: {'instances', 'cores', 'ram'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 00:53:37.486887 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-42cf42f3-52cd-4f9d-86a0-2ecbfea6b21d tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Getting quotas for user d9eee66bc32a4bf09c786f1227258c62 and project 12b6e06859f24f798b222c646238b39d. Resources: {'instances', 'cores', 'ram'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 00:53:37.499667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-42cf42f3-52cd-4f9d-86a0-2ecbfea6b21d tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Going to run 1 instances... {{(pid=125554) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 00:53:37.501868 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-42cf42f3-52cd-4f9d-86a0-2ecbfea6b21d tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27983dee-4bd6-4aad-9c28-22bd5382709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125554) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 00:53:37.554237 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-42cf42f3-52cd-4f9d-86a0-2ecbfea6b21d tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610101 Oct 30 00:53:37.554868 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 318/622] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Oct 30 00:53:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 00:53:37.566433 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5f7987b2-cd0d-4972-b7e8-a47a15844d69 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:37.567393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5f7987b2-cd0d-4972-b7e8-a47a15844d69 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:37.664357 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5f7987b2-cd0d-4972-b7e8-a47a15844d69 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9eee66bc32a4bf09c786f1227258c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b6e06859f24f798b222c646238b39d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:37.676649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5f7987b2-cd0d-4972-b7e8-a47a15844d69 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 200 len: 1214 microversion: 2.1 time: 0.113743 Oct 30 00:53:37.686058 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 305/623] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:37 2022] GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:37.808555 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d7dce71e-49ab-49be-a8e5-fb2b4148097c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:37.809165 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-d7dce71e-49ab-49be-a8e5-fb2b4148097c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:37.815756 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d7dce71e-49ab-49be-a8e5-fb2b4148097c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:37.816569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d7dce71e-49ab-49be-a8e5-fb2b4148097c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:37.817578 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d7dce71e-49ab-49be-a8e5-fb2b4148097c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:37.818276 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d7dce71e-49ab-49be-a8e5-fb2b4148097c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:37.818727 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d7dce71e-49ab-49be-a8e5-fb2b4148097c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:37.819147 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d7dce71e-49ab-49be-a8e5-fb2b4148097c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:37.966812 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-62914c80-62b5-4955-8709-1a2e495302e3 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:37.967688 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-62914c80-62b5-4955-8709-1a2e495302e3 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:37.975586 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-62914c80-62b5-4955-8709-1a2e495302e3 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:37.976116 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-62914c80-62b5-4955-8709-1a2e495302e3 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:37.976541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-62914c80-62b5-4955-8709-1a2e495302e3 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:37.980612 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-62914c80-62b5-4955-8709-1a2e495302e3 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:37.981312 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-62914c80-62b5-4955-8709-1a2e495302e3 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:37.981804 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-62914c80-62b5-4955-8709-1a2e495302e3 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:38.067659 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-62914c80-62b5-4955-8709-1a2e495302e3 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:38.072364 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-d7dce71e-49ab-49be-a8e5-fb2b4148097c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:38.075975 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-62914c80-62b5-4955-8709-1a2e495302e3 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17" status: 200 len: 1271 microversion: 2.1 time: 0.112900 Oct 30 00:53:38.076794 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 306/624] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:37 2022] GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17 => generated 1271 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:38.080505 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-d7dce71e-49ab-49be-a8e5-fb2b4148097c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1709 microversion: 2.1 time: 0.275859 Oct 30 00:53:38.081034 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-324964a2-9070-48db-afbe-a1afe87cab99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:38.081188 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 319/625] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:37 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1709 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:38.081935 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-324964a2-9070-48db-afbe-a1afe87cab99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:38.088184 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-324964a2-9070-48db-afbe-a1afe87cab99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:38.088864 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-324964a2-9070-48db-afbe-a1afe87cab99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:38.089477 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-324964a2-9070-48db-afbe-a1afe87cab99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:38.090346 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-324964a2-9070-48db-afbe-a1afe87cab99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:38.090959 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-324964a2-9070-48db-afbe-a1afe87cab99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:38.091552 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-324964a2-9070-48db-afbe-a1afe87cab99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:38.219638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-324964a2-9070-48db-afbe-a1afe87cab99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:38.229100 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-324964a2-9070-48db-afbe-a1afe87cab99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:38.230535 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-324964a2-9070-48db-afbe-a1afe87cab99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:38.231690 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-324964a2-9070-48db-afbe-a1afe87cab99 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.154211 Oct 30 00:53:38.232263 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 307/626] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:38 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:38.702400 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-27b9a44a-6bab-4b49-87ed-68f596966ff9 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:38.703012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-27b9a44a-6bab-4b49-87ed-68f596966ff9 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:38.711717 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-27b9a44a-6bab-4b49-87ed-68f596966ff9 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:38.712352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-27b9a44a-6bab-4b49-87ed-68f596966ff9 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:38.712878 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-27b9a44a-6bab-4b49-87ed-68f596966ff9 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:38.713691 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-27b9a44a-6bab-4b49-87ed-68f596966ff9 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:38.714234 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-27b9a44a-6bab-4b49-87ed-68f596966ff9 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:38.714794 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-27b9a44a-6bab-4b49-87ed-68f596966ff9 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:38.798036 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-27b9a44a-6bab-4b49-87ed-68f596966ff9 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9eee66bc32a4bf09c786f1227258c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b6e06859f24f798b222c646238b39d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:38.805606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-27b9a44a-6bab-4b49-87ed-68f596966ff9 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 200 len: 1210 microversion: 2.1 time: 0.109433 Oct 30 00:53:38.806157 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 320/627] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:38 2022] GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 1210 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:39.099738 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a69e2e0f-d1d5-4e16-a25d-ac93e3f95d24 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:39.100970 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a69e2e0f-d1d5-4e16-a25d-ac93e3f95d24 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:39.104111 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-99415b6a-376b-4130-9e11-711aeae5ad63 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:39.104727 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-99415b6a-376b-4130-9e11-711aeae5ad63 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:39.108603 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a69e2e0f-d1d5-4e16-a25d-ac93e3f95d24 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:39.109105 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a69e2e0f-d1d5-4e16-a25d-ac93e3f95d24 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:39.109715 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a69e2e0f-d1d5-4e16-a25d-ac93e3f95d24 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:39.111324 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a69e2e0f-d1d5-4e16-a25d-ac93e3f95d24 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:39.111760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-99415b6a-376b-4130-9e11-711aeae5ad63 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:39.111897 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a69e2e0f-d1d5-4e16-a25d-ac93e3f95d24 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:39.112299 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a69e2e0f-d1d5-4e16-a25d-ac93e3f95d24 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:39.112705 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-99415b6a-376b-4130-9e11-711aeae5ad63 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:39.113291 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-99415b6a-376b-4130-9e11-711aeae5ad63 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:39.114216 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-99415b6a-376b-4130-9e11-711aeae5ad63 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:39.114838 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-99415b6a-376b-4130-9e11-711aeae5ad63 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:39.115515 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-99415b6a-376b-4130-9e11-711aeae5ad63 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:39.608398 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-99415b6a-376b-4130-9e11-711aeae5ad63 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:39.612828 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a69e2e0f-d1d5-4e16-a25d-ac93e3f95d24 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:39.618048 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-99415b6a-376b-4130-9e11-711aeae5ad63 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1709 microversion: 2.1 time: 0.517639 Oct 30 00:53:39.620981 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 321/628] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:39 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1709 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:53:39.628809 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a69e2e0f-d1d5-4e16-a25d-ac93e3f95d24 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17" status: 200 len: 1319 microversion: 2.1 time: 0.530099 Oct 30 00:53:39.628935 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-9facb088-7ecf-410f-afb7-9c5efd99e7a0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:39.628935 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-9facb088-7ecf-410f-afb7-9c5efd99e7a0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:39.638177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 308/629] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:39 2022] GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17 => generated 1319 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:39.643574 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9facb088-7ecf-410f-afb7-9c5efd99e7a0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:39.644125 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9facb088-7ecf-410f-afb7-9c5efd99e7a0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:39.644582 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9facb088-7ecf-410f-afb7-9c5efd99e7a0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:39.647029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9facb088-7ecf-410f-afb7-9c5efd99e7a0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:39.647489 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9facb088-7ecf-410f-afb7-9c5efd99e7a0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:39.647927 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9facb088-7ecf-410f-afb7-9c5efd99e7a0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:39.780680 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9facb088-7ecf-410f-afb7-9c5efd99e7a0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:39.790011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9facb088-7ecf-410f-afb7-9c5efd99e7a0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:39.791423 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9facb088-7ecf-410f-afb7-9c5efd99e7a0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:39.793051 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-9facb088-7ecf-410f-afb7-9c5efd99e7a0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.171105 Oct 30 00:53:39.793591 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 322/630] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:39 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:39.829929 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-ef4554fe-a7ec-49b0-a35e-a66d2b076f31 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:39.830632 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-ef4554fe-a7ec-49b0-a35e-a66d2b076f31 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:39.837001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ef4554fe-a7ec-49b0-a35e-a66d2b076f31 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:39.837481 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ef4554fe-a7ec-49b0-a35e-a66d2b076f31 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:39.837904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ef4554fe-a7ec-49b0-a35e-a66d2b076f31 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:39.838595 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ef4554fe-a7ec-49b0-a35e-a66d2b076f31 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:39.839046 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ef4554fe-a7ec-49b0-a35e-a66d2b076f31 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:39.839467 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ef4554fe-a7ec-49b0-a35e-a66d2b076f31 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:39.918897 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ef4554fe-a7ec-49b0-a35e-a66d2b076f31 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9eee66bc32a4bf09c786f1227258c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b6e06859f24f798b222c646238b39d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:39.928312 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-ef4554fe-a7ec-49b0-a35e-a66d2b076f31 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 200 len: 1266 microversion: 2.1 time: 0.102158 Oct 30 00:53:39.929021 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 309/631] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:39 2022] GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:40.201481 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-cdc94f43-5c3a-408d-8e64-40e6f342e93d req-091cd5ae-9a00-4099-9f9c-64a4a346dd5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78677ee5-c3d5-404d-9755-4bffbba69f17", "tag": "d8df880f-485f-466c-b270-d75d712bf3a6"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:53:40.210776 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-cdc94f43-5c3a-408d-8e64-40e6f342e93d req-091cd5ae-9a00-4099-9f9c-64a4a346dd5b service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:40.211255 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-cdc94f43-5c3a-408d-8e64-40e6f342e93d req-091cd5ae-9a00-4099-9f9c-64a4a346dd5b service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:40.211680 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-cdc94f43-5c3a-408d-8e64-40e6f342e93d req-091cd5ae-9a00-4099-9f9c-64a4a346dd5b service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:40.224479 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-cdc94f43-5c3a-408d-8e64-40e6f342e93d req-091cd5ae-9a00-4099-9f9c-64a4a346dd5b service nova] Creating event network-changed:d8df880f-485f-466c-b270-d75d712bf3a6 for instance 78677ee5-c3d5-404d-9755-4bffbba69f17 on hv-cinder-86149 Oct 30 00:53:40.229688 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-cdc94f43-5c3a-408d-8e64-40e6f342e93d req-091cd5ae-9a00-4099-9f9c-64a4a346dd5b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031765 Oct 30 00:53:40.230526 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 323/632] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:53:40.653991 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1bfa6620-c379-4bfc-a9d5-4fb325a088e4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:40.655157 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2473274d-5ff1-4215-90e9-553d99c009ff tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:40.656021 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1bfa6620-c379-4bfc-a9d5-4fb325a088e4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:40.659383 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2473274d-5ff1-4215-90e9-553d99c009ff tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:40.667704 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2473274d-5ff1-4215-90e9-553d99c009ff tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:40.668340 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1bfa6620-c379-4bfc-a9d5-4fb325a088e4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:40.668469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2473274d-5ff1-4215-90e9-553d99c009ff tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:40.668828 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1bfa6620-c379-4bfc-a9d5-4fb325a088e4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:40.669080 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2473274d-5ff1-4215-90e9-553d99c009ff tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:40.669257 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1bfa6620-c379-4bfc-a9d5-4fb325a088e4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:40.669961 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1bfa6620-c379-4bfc-a9d5-4fb325a088e4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:40.670080 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2473274d-5ff1-4215-90e9-553d99c009ff tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:40.670480 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1bfa6620-c379-4bfc-a9d5-4fb325a088e4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:40.670703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2473274d-5ff1-4215-90e9-553d99c009ff tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:40.670895 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1bfa6620-c379-4bfc-a9d5-4fb325a088e4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:40.671321 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2473274d-5ff1-4215-90e9-553d99c009ff tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:40.865459 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1bfa6620-c379-4bfc-a9d5-4fb325a088e4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:40.869386 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2473274d-5ff1-4215-90e9-553d99c009ff tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:40.874148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1bfa6620-c379-4bfc-a9d5-4fb325a088e4 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1713 microversion: 2.1 time: 0.232730 Oct 30 00:53:40.877982 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 310/633] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:40 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1713 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:40.878650 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2473274d-5ff1-4215-90e9-553d99c009ff tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17" status: 200 len: 1319 microversion: 2.1 time: 0.229604 Oct 30 00:53:40.878650 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 324/634] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:40 2022] GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:40.879154 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d3e905c3-0b91-4e15-9476-2b0f6eba72d4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:40.879751 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d3e905c3-0b91-4e15-9476-2b0f6eba72d4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:40.886057 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d3e905c3-0b91-4e15-9476-2b0f6eba72d4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:40.886544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d3e905c3-0b91-4e15-9476-2b0f6eba72d4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:40.886977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d3e905c3-0b91-4e15-9476-2b0f6eba72d4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:40.887664 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d3e905c3-0b91-4e15-9476-2b0f6eba72d4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:40.888150 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d3e905c3-0b91-4e15-9476-2b0f6eba72d4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:40.888572 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d3e905c3-0b91-4e15-9476-2b0f6eba72d4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:40.950921 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ab414aad-21c6-4427-ae12-0698881776c1 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:40.951533 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ab414aad-21c6-4427-ae12-0698881776c1 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:40.958583 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ab414aad-21c6-4427-ae12-0698881776c1 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:40.959168 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ab414aad-21c6-4427-ae12-0698881776c1 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:40.959563 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ab414aad-21c6-4427-ae12-0698881776c1 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:40.960372 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ab414aad-21c6-4427-ae12-0698881776c1 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:40.960826 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ab414aad-21c6-4427-ae12-0698881776c1 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:40.961253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ab414aad-21c6-4427-ae12-0698881776c1 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:41.025113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ab414aad-21c6-4427-ae12-0698881776c1 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9eee66bc32a4bf09c786f1227258c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b6e06859f24f798b222c646238b39d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:41.028654 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=100 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:41.033741 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ab414aad-21c6-4427-ae12-0698881776c1 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 200 len: 1274 microversion: 2.1 time: 0.087077 Oct 30 00:53:41.034313 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 325/635] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:40 2022] GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:53:41.050775 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d3e905c3-0b91-4e15-9476-2b0f6eba72d4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:41.060279 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d3e905c3-0b91-4e15-9476-2b0f6eba72d4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:41.061710 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d3e905c3-0b91-4e15-9476-2b0f6eba72d4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:41.062864 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d3e905c3-0b91-4e15-9476-2b0f6eba72d4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.187243 Oct 30 00:53:41.063418 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 311/636] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:40 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:41.899319 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-27b3616a-dd12-463c-b05b-e6bc1e4148be tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:41.899993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-27b3616a-dd12-463c-b05b-e6bc1e4148be tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:41.908583 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-27b3616a-dd12-463c-b05b-e6bc1e4148be tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:41.909076 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-27b3616a-dd12-463c-b05b-e6bc1e4148be tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:41.909562 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-27b3616a-dd12-463c-b05b-e6bc1e4148be tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:41.910463 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-27b3616a-dd12-463c-b05b-e6bc1e4148be tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:41.910925 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-27b3616a-dd12-463c-b05b-e6bc1e4148be tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:41.911356 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-27b3616a-dd12-463c-b05b-e6bc1e4148be tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:42.058055 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-81ee2906-326b-4b9e-83e7-97808c7ddcc3 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:42.059324 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-81ee2906-326b-4b9e-83e7-97808c7ddcc3 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:42.065960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-81ee2906-326b-4b9e-83e7-97808c7ddcc3 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:42.066451 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-81ee2906-326b-4b9e-83e7-97808c7ddcc3 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:42.066882 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-81ee2906-326b-4b9e-83e7-97808c7ddcc3 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:42.067584 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-81ee2906-326b-4b9e-83e7-97808c7ddcc3 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:42.068035 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-81ee2906-326b-4b9e-83e7-97808c7ddcc3 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:42.068495 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-81ee2906-326b-4b9e-83e7-97808c7ddcc3 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:42.099586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-27b3616a-dd12-463c-b05b-e6bc1e4148be tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:42.107486 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-27b3616a-dd12-463c-b05b-e6bc1e4148be tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17" status: 200 len: 1319 microversion: 2.1 time: 0.212315 Oct 30 00:53:42.108215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 326/637] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:41 2022] GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:42.113501 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-898a1074-d20d-462e-ab0a-82871939ce9c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:42.113501 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-898a1074-d20d-462e-ab0a-82871939ce9c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:42.123158 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-898a1074-d20d-462e-ab0a-82871939ce9c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:42.123914 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-898a1074-d20d-462e-ab0a-82871939ce9c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:42.124379 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-898a1074-d20d-462e-ab0a-82871939ce9c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:42.125091 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-898a1074-d20d-462e-ab0a-82871939ce9c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:42.125545 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-898a1074-d20d-462e-ab0a-82871939ce9c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:42.125965 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-898a1074-d20d-462e-ab0a-82871939ce9c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:42.343327 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-81ee2906-326b-4b9e-83e7-97808c7ddcc3 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9eee66bc32a4bf09c786f1227258c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b6e06859f24f798b222c646238b39d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:42.351031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-81ee2906-326b-4b9e-83e7-97808c7ddcc3 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 200 len: 1314 microversion: 2.1 time: 0.296896 Oct 30 00:53:42.351591 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 312/638] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:42 2022] GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:42.365129 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-898a1074-d20d-462e-ab0a-82871939ce9c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:42.373644 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-898a1074-d20d-462e-ab0a-82871939ce9c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:42.375045 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-898a1074-d20d-462e-ab0a-82871939ce9c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:42.376199 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-898a1074-d20d-462e-ab0a-82871939ce9c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.267037 Oct 30 00:53:42.376746 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 327/639] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:42 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:43.131437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-8b1c5f88-ae2e-4ff9-9351-0e7b12eb89d6 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:43.131991 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-8b1c5f88-ae2e-4ff9-9351-0e7b12eb89d6 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:43.138384 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8b1c5f88-ae2e-4ff9-9351-0e7b12eb89d6 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:43.138857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8b1c5f88-ae2e-4ff9-9351-0e7b12eb89d6 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:43.139292 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8b1c5f88-ae2e-4ff9-9351-0e7b12eb89d6 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:43.139971 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8b1c5f88-ae2e-4ff9-9351-0e7b12eb89d6 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:43.140439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8b1c5f88-ae2e-4ff9-9351-0e7b12eb89d6 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:43.140858 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8b1c5f88-ae2e-4ff9-9351-0e7b12eb89d6 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:43.272355 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8b1c5f88-ae2e-4ff9-9351-0e7b12eb89d6 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:43.279895 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-8b1c5f88-ae2e-4ff9-9351-0e7b12eb89d6 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17" status: 200 len: 1319 microversion: 2.1 time: 0.152893 Oct 30 00:53:43.280559 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 313/640] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:43 2022] GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:43.374891 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7921eb95-2de6-4405-a66c-feb636197036 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:43.375563 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-7921eb95-2de6-4405-a66c-feb636197036 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:43.382250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7921eb95-2de6-4405-a66c-feb636197036 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:43.382672 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7921eb95-2de6-4405-a66c-feb636197036 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:43.383103 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7921eb95-2de6-4405-a66c-feb636197036 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:43.383786 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7921eb95-2de6-4405-a66c-feb636197036 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:43.384269 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7921eb95-2de6-4405-a66c-feb636197036 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:43.384691 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7921eb95-2de6-4405-a66c-feb636197036 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:43.402207 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-4ac03358-fa6c-4ad0-80fd-9193176d7c4c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:43.402830 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-4ac03358-fa6c-4ad0-80fd-9193176d7c4c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:43.408707 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4ac03358-fa6c-4ad0-80fd-9193176d7c4c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:43.409180 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4ac03358-fa6c-4ad0-80fd-9193176d7c4c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:43.409608 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4ac03358-fa6c-4ad0-80fd-9193176d7c4c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:43.410287 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4ac03358-fa6c-4ad0-80fd-9193176d7c4c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:43.410738 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4ac03358-fa6c-4ad0-80fd-9193176d7c4c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:43.411831 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4ac03358-fa6c-4ad0-80fd-9193176d7c4c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:43.584916 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7921eb95-2de6-4405-a66c-feb636197036 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9eee66bc32a4bf09c786f1227258c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b6e06859f24f798b222c646238b39d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:43.589412 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-4ac03358-fa6c-4ad0-80fd-9193176d7c4c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:43.592999 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7921eb95-2de6-4405-a66c-feb636197036 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 200 len: 1314 microversion: 2.1 time: 0.222083 Oct 30 00:53:43.593561 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 328/641] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:43 2022] GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:43.598172 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-4ac03358-fa6c-4ad0-80fd-9193176d7c4c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:43.599616 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-4ac03358-fa6c-4ad0-80fd-9193176d7c4c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:43.600794 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-4ac03358-fa6c-4ad0-80fd-9193176d7c4c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.202387 Oct 30 00:53:43.601344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 314/642] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:43 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:53:44.303124 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2816fe73-1172-4f3f-9404-e2a2095be62c tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:44.303719 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2816fe73-1172-4f3f-9404-e2a2095be62c tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:44.310481 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2816fe73-1172-4f3f-9404-e2a2095be62c tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:44.310984 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2816fe73-1172-4f3f-9404-e2a2095be62c tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:44.311417 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2816fe73-1172-4f3f-9404-e2a2095be62c tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:44.312149 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2816fe73-1172-4f3f-9404-e2a2095be62c tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:44.312600 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2816fe73-1172-4f3f-9404-e2a2095be62c tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:44.313017 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2816fe73-1172-4f3f-9404-e2a2095be62c tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:44.439473 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2816fe73-1172-4f3f-9404-e2a2095be62c tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:44.447680 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2816fe73-1172-4f3f-9404-e2a2095be62c tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17" status: 200 len: 1319 microversion: 2.1 time: 0.148382 Oct 30 00:53:44.448257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 329/643] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:44 2022] GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:44.616140 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-563fbc87-67b8-4bcd-b6ea-5fe21e4a2bcc tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:44.616674 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-563fbc87-67b8-4bcd-b6ea-5fe21e4a2bcc tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:44.623076 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-563fbc87-67b8-4bcd-b6ea-5fe21e4a2bcc tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:44.623558 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-563fbc87-67b8-4bcd-b6ea-5fe21e4a2bcc tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:44.623986 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-563fbc87-67b8-4bcd-b6ea-5fe21e4a2bcc tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:44.624700 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-563fbc87-67b8-4bcd-b6ea-5fe21e4a2bcc tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:44.625145 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-563fbc87-67b8-4bcd-b6ea-5fe21e4a2bcc tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:44.625569 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-563fbc87-67b8-4bcd-b6ea-5fe21e4a2bcc tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:44.626370 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-3d01963c-118a-4bee-80d1-01b2295695f6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:44.626970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-3d01963c-118a-4bee-80d1-01b2295695f6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:44.633253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3d01963c-118a-4bee-80d1-01b2295695f6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:44.633729 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3d01963c-118a-4bee-80d1-01b2295695f6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:44.634163 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3d01963c-118a-4bee-80d1-01b2295695f6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:44.634846 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3d01963c-118a-4bee-80d1-01b2295695f6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:44.635321 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3d01963c-118a-4bee-80d1-01b2295695f6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:44.635737 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3d01963c-118a-4bee-80d1-01b2295695f6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:44.873510 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-563fbc87-67b8-4bcd-b6ea-5fe21e4a2bcc tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9eee66bc32a4bf09c786f1227258c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b6e06859f24f798b222c646238b39d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:44.880392 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-3d01963c-118a-4bee-80d1-01b2295695f6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:44.880604 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-563fbc87-67b8-4bcd-b6ea-5fe21e4a2bcc tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 200 len: 1314 microversion: 2.1 time: 0.268910 Oct 30 00:53:44.881172 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 315/644] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:44 2022] GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:44.900421 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-3d01963c-118a-4bee-80d1-01b2295695f6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:44.901820 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-3d01963c-118a-4bee-80d1-01b2295695f6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:44.902975 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-3d01963c-118a-4bee-80d1-01b2295695f6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.280458 Oct 30 00:53:44.903548 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 330/645] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:44 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:53:45.470685 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-9e8cc89f-97a8-473a-bbcd-5932e116b876 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:45.471370 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-9e8cc89f-97a8-473a-bbcd-5932e116b876 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:45.478517 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9e8cc89f-97a8-473a-bbcd-5932e116b876 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:45.478721 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-0ec9b878-88a1-42f6-9436-4b4b8424c1d9 req-590b87f5-7755-4179-9b7d-ff183b3b351c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc119c64-c007-4eff-8ccb-bd6de3dd57dc", "tag": "bdf9e24c-b177-426a-8caa-f4864bb19b70"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:53:45.479162 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9e8cc89f-97a8-473a-bbcd-5932e116b876 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:45.479428 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9e8cc89f-97a8-473a-bbcd-5932e116b876 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:45.480154 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9e8cc89f-97a8-473a-bbcd-5932e116b876 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:45.480606 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9e8cc89f-97a8-473a-bbcd-5932e116b876 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:45.481196 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9e8cc89f-97a8-473a-bbcd-5932e116b876 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:45.485313 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:45.493051 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-0ec9b878-88a1-42f6-9436-4b4b8424c1d9 req-590b87f5-7755-4179-9b7d-ff183b3b351c service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:45.493750 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-0ec9b878-88a1-42f6-9436-4b4b8424c1d9 req-590b87f5-7755-4179-9b7d-ff183b3b351c service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:45.494332 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-0ec9b878-88a1-42f6-9436-4b4b8424c1d9 req-590b87f5-7755-4179-9b7d-ff183b3b351c service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:45.508874 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-0ec9b878-88a1-42f6-9436-4b4b8424c1d9 req-590b87f5-7755-4179-9b7d-ff183b3b351c service nova] Creating event network-changed:bdf9e24c-b177-426a-8caa-f4864bb19b70 for instance bc119c64-c007-4eff-8ccb-bd6de3dd57dc on hv-cinder-86149 Oct 30 00:53:45.513727 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-0ec9b878-88a1-42f6-9436-4b4b8424c1d9 req-590b87f5-7755-4179-9b7d-ff183b3b351c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038631 Oct 30 00:53:45.514931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 331/646] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:53:45.617568 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-9e8cc89f-97a8-473a-bbcd-5932e116b876 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:45.625647 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-9e8cc89f-97a8-473a-bbcd-5932e116b876 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17" status: 200 len: 1319 microversion: 2.1 time: 0.158767 Oct 30 00:53:45.626198 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 316/647] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:45 2022] GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:45.903443 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2b8cced6-9a3d-435a-b16f-878bca2226dc tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:45.904237 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2b8cced6-9a3d-435a-b16f-878bca2226dc tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:45.910397 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2b8cced6-9a3d-435a-b16f-878bca2226dc tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:45.911369 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2b8cced6-9a3d-435a-b16f-878bca2226dc tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:45.911873 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2b8cced6-9a3d-435a-b16f-878bca2226dc tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:45.912709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2b8cced6-9a3d-435a-b16f-878bca2226dc tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:45.913153 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2b8cced6-9a3d-435a-b16f-878bca2226dc tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:45.913571 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2b8cced6-9a3d-435a-b16f-878bca2226dc tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:45.930088 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-6e54fb80-c069-45fe-b6f9-c75444901083 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:45.930682 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-6e54fb80-c069-45fe-b6f9-c75444901083 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:45.936683 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6e54fb80-c069-45fe-b6f9-c75444901083 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:45.937161 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6e54fb80-c069-45fe-b6f9-c75444901083 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:45.937588 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6e54fb80-c069-45fe-b6f9-c75444901083 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:45.938274 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6e54fb80-c069-45fe-b6f9-c75444901083 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:45.938719 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6e54fb80-c069-45fe-b6f9-c75444901083 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:45.939135 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6e54fb80-c069-45fe-b6f9-c75444901083 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:46.116738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2b8cced6-9a3d-435a-b16f-878bca2226dc tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9eee66bc32a4bf09c786f1227258c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b6e06859f24f798b222c646238b39d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:46.120396 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-6e54fb80-c069-45fe-b6f9-c75444901083 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:46.124411 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2b8cced6-9a3d-435a-b16f-878bca2226dc tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 200 len: 1314 microversion: 2.1 time: 0.225229 Oct 30 00:53:46.124980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 332/648] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:45 2022] GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:46.129236 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-6e54fb80-c069-45fe-b6f9-c75444901083 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:46.130741 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-6e54fb80-c069-45fe-b6f9-c75444901083 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:46.131891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-6e54fb80-c069-45fe-b6f9-c75444901083 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.206704 Oct 30 00:53:46.132460 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 317/649] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:45 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:53:46.649372 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7a34ab59-62f1-4dee-a016-57526b0fd03d tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:46.649977 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-7a34ab59-62f1-4dee-a016-57526b0fd03d tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:46.657062 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7a34ab59-62f1-4dee-a016-57526b0fd03d tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:46.657543 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7a34ab59-62f1-4dee-a016-57526b0fd03d tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:46.657975 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7a34ab59-62f1-4dee-a016-57526b0fd03d tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:46.658663 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7a34ab59-62f1-4dee-a016-57526b0fd03d tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:46.659112 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7a34ab59-62f1-4dee-a016-57526b0fd03d tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:46.659536 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7a34ab59-62f1-4dee-a016-57526b0fd03d tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:46.860198 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7a34ab59-62f1-4dee-a016-57526b0fd03d tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:46.868924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7a34ab59-62f1-4dee-a016-57526b0fd03d tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17" status: 200 len: 1319 microversion: 2.1 time: 0.223315 Oct 30 00:53:46.869495 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 333/650] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:46 2022] GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:47.098386 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-87dbb87d-c788-4fd3-957f-aa51f1de1b5e req-14ca802a-329e-4ab6-b1ec-73c706be67d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78677ee5-c3d5-404d-9755-4bffbba69f17", "name": "network-vif-plugged", "status": "completed", "tag": "d8df880f-485f-466c-b270-d75d712bf3a6"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:53:47.109434 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-87dbb87d-c788-4fd3-957f-aa51f1de1b5e req-14ca802a-329e-4ab6-b1ec-73c706be67d3 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:47.109980 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-87dbb87d-c788-4fd3-957f-aa51f1de1b5e req-14ca802a-329e-4ab6-b1ec-73c706be67d3 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:47.110694 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-87dbb87d-c788-4fd3-957f-aa51f1de1b5e req-14ca802a-329e-4ab6-b1ec-73c706be67d3 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:47.122709 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-87dbb87d-c788-4fd3-957f-aa51f1de1b5e req-14ca802a-329e-4ab6-b1ec-73c706be67d3 service nova] Creating event network-vif-plugged:d8df880f-485f-466c-b270-d75d712bf3a6 for instance 78677ee5-c3d5-404d-9755-4bffbba69f17 on hv-cinder-86149 Oct 30 00:53:47.128224 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-87dbb87d-c788-4fd3-957f-aa51f1de1b5e req-14ca802a-329e-4ab6-b1ec-73c706be67d3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033445 Oct 30 00:53:47.129285 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 318/651] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 00:53:47.147533 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-55754f81-9b3f-4f3f-993d-ea519525fcc8 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:47.148169 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-55754f81-9b3f-4f3f-993d-ea519525fcc8 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:47.154190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55754f81-9b3f-4f3f-993d-ea519525fcc8 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:47.154889 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55754f81-9b3f-4f3f-993d-ea519525fcc8 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:47.155353 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55754f81-9b3f-4f3f-993d-ea519525fcc8 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:47.156054 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55754f81-9b3f-4f3f-993d-ea519525fcc8 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:47.156520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55754f81-9b3f-4f3f-993d-ea519525fcc8 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:47.156932 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55754f81-9b3f-4f3f-993d-ea519525fcc8 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:47.158793 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-8a8a7ad2-a66b-4523-a4a8-672fd8335804 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:47.159827 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-8a8a7ad2-a66b-4523-a4a8-672fd8335804 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:47.166868 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a8a7ad2-a66b-4523-a4a8-672fd8335804 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:47.167450 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a8a7ad2-a66b-4523-a4a8-672fd8335804 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:47.167990 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a8a7ad2-a66b-4523-a4a8-672fd8335804 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:47.169725 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a8a7ad2-a66b-4523-a4a8-672fd8335804 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:47.170577 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a8a7ad2-a66b-4523-a4a8-672fd8335804 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:47.171072 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a8a7ad2-a66b-4523-a4a8-672fd8335804 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:47.367496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-55754f81-9b3f-4f3f-993d-ea519525fcc8 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9eee66bc32a4bf09c786f1227258c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b6e06859f24f798b222c646238b39d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:47.371571 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8a8a7ad2-a66b-4523-a4a8-672fd8335804 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:47.375337 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-55754f81-9b3f-4f3f-993d-ea519525fcc8 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 200 len: 1314 microversion: 2.1 time: 0.232388 Oct 30 00:53:47.375906 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 334/652] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:47 2022] GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:47.380185 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8a8a7ad2-a66b-4523-a4a8-672fd8335804 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:47.381666 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8a8a7ad2-a66b-4523-a4a8-672fd8335804 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:47.382959 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-8a8a7ad2-a66b-4523-a4a8-672fd8335804 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.229050 Oct 30 00:53:47.383501 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 319/653] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:47 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:47.893322 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c94efe19-e0aa-413f-bd5a-3d747a9cf24e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:47.893920 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c94efe19-e0aa-413f-bd5a-3d747a9cf24e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:47.895827 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=4 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:47.896640 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=14 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:47.903195 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c94efe19-e0aa-413f-bd5a-3d747a9cf24e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:47.903668 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c94efe19-e0aa-413f-bd5a-3d747a9cf24e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:47.904107 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c94efe19-e0aa-413f-bd5a-3d747a9cf24e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:47.904797 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c94efe19-e0aa-413f-bd5a-3d747a9cf24e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:47.905241 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c94efe19-e0aa-413f-bd5a-3d747a9cf24e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:47.905655 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c94efe19-e0aa-413f-bd5a-3d747a9cf24e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:48.041888 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c94efe19-e0aa-413f-bd5a-3d747a9cf24e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:48.049870 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c94efe19-e0aa-413f-bd5a-3d747a9cf24e tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17" status: 200 len: 1319 microversion: 2.1 time: 0.160259 Oct 30 00:53:48.050858 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 335/654] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:47 2022] GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:48.399155 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-df36686a-ab1f-471a-b1db-8fa23ea2d196 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:48.399763 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-df36686a-ab1f-471a-b1db-8fa23ea2d196 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:48.401720 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=2 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:48.407431 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-df36686a-ab1f-471a-b1db-8fa23ea2d196 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:48.407914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-df36686a-ab1f-471a-b1db-8fa23ea2d196 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:48.408372 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-df36686a-ab1f-471a-b1db-8fa23ea2d196 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:48.409061 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-df36686a-ab1f-471a-b1db-8fa23ea2d196 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:48.409344 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-3fc787d5-cb31-4d83-bd6e-1117eabf429a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:48.409579 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-df36686a-ab1f-471a-b1db-8fa23ea2d196 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:48.409952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-3fc787d5-cb31-4d83-bd6e-1117eabf429a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:48.410057 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-df36686a-ab1f-471a-b1db-8fa23ea2d196 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:48.416311 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3fc787d5-cb31-4d83-bd6e-1117eabf429a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:48.416789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3fc787d5-cb31-4d83-bd6e-1117eabf429a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:48.417218 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3fc787d5-cb31-4d83-bd6e-1117eabf429a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:48.417905 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3fc787d5-cb31-4d83-bd6e-1117eabf429a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:48.418353 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3fc787d5-cb31-4d83-bd6e-1117eabf429a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:48.418776 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3fc787d5-cb31-4d83-bd6e-1117eabf429a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:48.603468 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-3fc787d5-cb31-4d83-bd6e-1117eabf429a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:48.610291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-df36686a-ab1f-471a-b1db-8fa23ea2d196 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9eee66bc32a4bf09c786f1227258c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b6e06859f24f798b222c646238b39d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:48.612099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-3fc787d5-cb31-4d83-bd6e-1117eabf429a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:48.613530 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-3fc787d5-cb31-4d83-bd6e-1117eabf429a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:48.614683 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-3fc787d5-cb31-4d83-bd6e-1117eabf429a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.209232 Oct 30 00:53:48.615943 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 336/655] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:48 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:53:48.619499 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-df36686a-ab1f-471a-b1db-8fa23ea2d196 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 200 len: 1314 microversion: 2.1 time: 0.224157 Oct 30 00:53:48.620042 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 320/656] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:48 2022] GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:49.074522 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c3fc93c6-1e1d-42df-a9b0-7d69d668b071 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:49.075133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c3fc93c6-1e1d-42df-a9b0-7d69d668b071 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:49.081659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c3fc93c6-1e1d-42df-a9b0-7d69d668b071 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:49.082144 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c3fc93c6-1e1d-42df-a9b0-7d69d668b071 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:49.082578 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c3fc93c6-1e1d-42df-a9b0-7d69d668b071 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:49.083271 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c3fc93c6-1e1d-42df-a9b0-7d69d668b071 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:49.084811 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c3fc93c6-1e1d-42df-a9b0-7d69d668b071 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:49.084955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c3fc93c6-1e1d-42df-a9b0-7d69d668b071 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:49.215191 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c3fc93c6-1e1d-42df-a9b0-7d69d668b071 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:49.222795 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c3fc93c6-1e1d-42df-a9b0-7d69d668b071 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17" status: 200 len: 1319 microversion: 2.1 time: 0.152363 Oct 30 00:53:49.223344 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 337/657] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:49 2022] GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:49.641294 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b253e403-a5a1-48ab-b9a3-ddad39a9a1e2 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:49.641781 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1781d93b-5d18-4025-9f99-506abfad7505 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:49.642276 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-b253e403-a5a1-48ab-b9a3-ddad39a9a1e2 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:49.642463 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1781d93b-5d18-4025-9f99-506abfad7505 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:49.648931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b253e403-a5a1-48ab-b9a3-ddad39a9a1e2 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:49.649410 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b253e403-a5a1-48ab-b9a3-ddad39a9a1e2 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:49.649642 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1781d93b-5d18-4025-9f99-506abfad7505 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:49.649897 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b253e403-a5a1-48ab-b9a3-ddad39a9a1e2 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:49.650124 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1781d93b-5d18-4025-9f99-506abfad7505 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:49.650560 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1781d93b-5d18-4025-9f99-506abfad7505 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:49.650687 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b253e403-a5a1-48ab-b9a3-ddad39a9a1e2 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:49.651536 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b253e403-a5a1-48ab-b9a3-ddad39a9a1e2 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:49.651662 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1781d93b-5d18-4025-9f99-506abfad7505 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:49.651745 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b253e403-a5a1-48ab-b9a3-ddad39a9a1e2 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:49.651820 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1781d93b-5d18-4025-9f99-506abfad7505 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:49.652220 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1781d93b-5d18-4025-9f99-506abfad7505 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:49.656477 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:49.842348 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1781d93b-5d18-4025-9f99-506abfad7505 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:49.851111 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1781d93b-5d18-4025-9f99-506abfad7505 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:49.852440 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1781d93b-5d18-4025-9f99-506abfad7505 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:49.853596 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1781d93b-5d18-4025-9f99-506abfad7505 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.216465 Oct 30 00:53:49.853977 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b253e403-a5a1-48ab-b9a3-ddad39a9a1e2 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9eee66bc32a4bf09c786f1227258c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b6e06859f24f798b222c646238b39d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:49.854142 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 321/658] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:49 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:49.861800 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b253e403-a5a1-48ab-b9a3-ddad39a9a1e2 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 200 len: 1314 microversion: 2.1 time: 0.224339 Oct 30 00:53:49.862440 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 338/659] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:49 2022] GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:53:50.244658 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-faa46f30-3e04-44fd-868e-513349031947 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:50.245269 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-faa46f30-3e04-44fd-868e-513349031947 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:50.252006 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-faa46f30-3e04-44fd-868e-513349031947 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:50.252528 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-faa46f30-3e04-44fd-868e-513349031947 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:50.252952 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-faa46f30-3e04-44fd-868e-513349031947 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:50.253636 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-faa46f30-3e04-44fd-868e-513349031947 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:50.254081 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-faa46f30-3e04-44fd-868e-513349031947 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:50.254497 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-faa46f30-3e04-44fd-868e-513349031947 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:50.385724 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-faa46f30-3e04-44fd-868e-513349031947 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:50.393452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-faa46f30-3e04-44fd-868e-513349031947 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17" status: 200 len: 1319 microversion: 2.1 time: 0.152597 Oct 30 00:53:50.394008 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 322/660] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:50 2022] GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:50.879146 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-285c2ab0-db1e-42b6-a080-f2610cbea670 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:50.879759 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-285c2ab0-db1e-42b6-a080-f2610cbea670 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:50.885425 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-6a7835cc-d264-4014-8e82-016b51e15c57 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:50.886230 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-6a7835cc-d264-4014-8e82-016b51e15c57 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:50.886933 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-285c2ab0-db1e-42b6-a080-f2610cbea670 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:50.887415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-285c2ab0-db1e-42b6-a080-f2610cbea670 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:50.887856 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-285c2ab0-db1e-42b6-a080-f2610cbea670 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:50.888573 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-285c2ab0-db1e-42b6-a080-f2610cbea670 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:50.889032 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-285c2ab0-db1e-42b6-a080-f2610cbea670 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:50.889459 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-285c2ab0-db1e-42b6-a080-f2610cbea670 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:50.892863 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6a7835cc-d264-4014-8e82-016b51e15c57 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:50.893349 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6a7835cc-d264-4014-8e82-016b51e15c57 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:50.893775 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6a7835cc-d264-4014-8e82-016b51e15c57 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:50.894467 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6a7835cc-d264-4014-8e82-016b51e15c57 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:50.894908 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6a7835cc-d264-4014-8e82-016b51e15c57 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:50.895492 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6a7835cc-d264-4014-8e82-016b51e15c57 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:51.097371 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-285c2ab0-db1e-42b6-a080-f2610cbea670 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:51.101629 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-6a7835cc-d264-4014-8e82-016b51e15c57 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9eee66bc32a4bf09c786f1227258c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b6e06859f24f798b222c646238b39d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:51.109634 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-6a7835cc-d264-4014-8e82-016b51e15c57 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 200 len: 1314 microversion: 2.1 time: 0.227829 Oct 30 00:53:51.110430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 323/661] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:50 2022] GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:53:51.110567 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-285c2ab0-db1e-42b6-a080-f2610cbea670 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:51.112501 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-285c2ab0-db1e-42b6-a080-f2610cbea670 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:51.114502 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-285c2ab0-db1e-42b6-a080-f2610cbea670 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.239093 Oct 30 00:53:51.120468 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 339/662] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:50 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:51.279155 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-3dd0c6a8-381c-4247-84bf-a785c2f5e673 req-c3034033-1602-41ea-9aef-a0c52b3a485d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00747eb3-1c2b-40b2-8e0a-9c440529e833", "name": "network-vif-plugged", "status": "completed", "tag": "0b7471a7-8df2-4f56-8dad-8f89610685f3"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:53:51.289105 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-3dd0c6a8-381c-4247-84bf-a785c2f5e673 req-c3034033-1602-41ea-9aef-a0c52b3a485d service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:51.289580 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-3dd0c6a8-381c-4247-84bf-a785c2f5e673 req-c3034033-1602-41ea-9aef-a0c52b3a485d service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:51.290003 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-3dd0c6a8-381c-4247-84bf-a785c2f5e673 req-c3034033-1602-41ea-9aef-a0c52b3a485d service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:51.301671 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-3dd0c6a8-381c-4247-84bf-a785c2f5e673 req-c3034033-1602-41ea-9aef-a0c52b3a485d service nova] Creating event network-vif-plugged:0b7471a7-8df2-4f56-8dad-8f89610685f3 for instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 on hv-cinder-86149 Oct 30 00:53:51.308296 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-3dd0c6a8-381c-4247-84bf-a785c2f5e673 req-c3034033-1602-41ea-9aef-a0c52b3a485d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032774 Oct 30 00:53:51.308882 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 324/663] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:53:51.417883 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c8c1a098-ed68-441b-ade5-577cae599841 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:51.418742 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c8c1a098-ed68-441b-ade5-577cae599841 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:51.425842 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c8c1a098-ed68-441b-ade5-577cae599841 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:51.426541 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c8c1a098-ed68-441b-ade5-577cae599841 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:51.427167 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c8c1a098-ed68-441b-ade5-577cae599841 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:51.428725 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c8c1a098-ed68-441b-ade5-577cae599841 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:51.429463 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c8c1a098-ed68-441b-ade5-577cae599841 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:51.430079 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c8c1a098-ed68-441b-ade5-577cae599841 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:51.779176 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c8c1a098-ed68-441b-ade5-577cae599841 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:51.787305 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c8c1a098-ed68-441b-ade5-577cae599841 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17" status: 200 len: 1319 microversion: 2.1 time: 0.374332 Oct 30 00:53:51.787867 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 340/664] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:51 2022] GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17 => generated 1319 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:52.133921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1d2ab25b-98d1-400e-9bb0-9b160cb2887b tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:52.135456 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1d2ab25b-98d1-400e-9bb0-9b160cb2887b tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:52.140496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-78c2a8a4-892b-45bd-a6d4-438ee82a8b33 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:52.141103 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-78c2a8a4-892b-45bd-a6d4-438ee82a8b33 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:52.141699 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1d2ab25b-98d1-400e-9bb0-9b160cb2887b tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:52.142203 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1d2ab25b-98d1-400e-9bb0-9b160cb2887b tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:52.142632 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1d2ab25b-98d1-400e-9bb0-9b160cb2887b tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:52.143318 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1d2ab25b-98d1-400e-9bb0-9b160cb2887b tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:52.143759 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1d2ab25b-98d1-400e-9bb0-9b160cb2887b tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:52.144227 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1d2ab25b-98d1-400e-9bb0-9b160cb2887b tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:52.147490 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78c2a8a4-892b-45bd-a6d4-438ee82a8b33 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:52.147965 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78c2a8a4-892b-45bd-a6d4-438ee82a8b33 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:52.148438 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78c2a8a4-892b-45bd-a6d4-438ee82a8b33 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:52.149129 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78c2a8a4-892b-45bd-a6d4-438ee82a8b33 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:52.149638 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78c2a8a4-892b-45bd-a6d4-438ee82a8b33 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:52.150086 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-78c2a8a4-892b-45bd-a6d4-438ee82a8b33 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:52.338017 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1d2ab25b-98d1-400e-9bb0-9b160cb2887b tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9eee66bc32a4bf09c786f1227258c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b6e06859f24f798b222c646238b39d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:52.341835 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-78c2a8a4-892b-45bd-a6d4-438ee82a8b33 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:52.345895 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1d2ab25b-98d1-400e-9bb0-9b160cb2887b tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 200 len: 1314 microversion: 2.1 time: 0.217405 Oct 30 00:53:52.346455 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 325/665] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:52 2022] GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:52.351444 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-78c2a8a4-892b-45bd-a6d4-438ee82a8b33 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:52.352976 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-78c2a8a4-892b-45bd-a6d4-438ee82a8b33 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:52.354196 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-78c2a8a4-892b-45bd-a6d4-438ee82a8b33 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.217507 Oct 30 00:53:52.354808 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 341/666] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:52 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:52.810796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5c98b8cb-c990-45b4-a329-2bf307a6acd8 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:52.811464 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5c98b8cb-c990-45b4-a329-2bf307a6acd8 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:52.813461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=76 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:52.818705 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5c98b8cb-c990-45b4-a329-2bf307a6acd8 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:52.819186 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5c98b8cb-c990-45b4-a329-2bf307a6acd8 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:52.819623 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5c98b8cb-c990-45b4-a329-2bf307a6acd8 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:52.820354 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5c98b8cb-c990-45b4-a329-2bf307a6acd8 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:52.820836 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5c98b8cb-c990-45b4-a329-2bf307a6acd8 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:52.821260 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5c98b8cb-c990-45b4-a329-2bf307a6acd8 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:52.948722 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5c98b8cb-c990-45b4-a329-2bf307a6acd8 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:52.956263 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5c98b8cb-c990-45b4-a329-2bf307a6acd8 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17" status: 200 len: 1507 microversion: 2.1 time: 0.149297 Oct 30 00:53:52.956820 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 326/667] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:52 2022] GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:52.979758 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-62b09cb9-e689-48b5-bba6-de1649f87616 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b730f4b-359f-4669-b451-b7018983b04c", "device": "/dev/sdb"}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:53:52.982671 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-62b09cb9-e689-48b5-bba6-de1649f87616 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:52.988845 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-62b09cb9-e689-48b5-bba6-de1649f87616 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:52.989340 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-62b09cb9-e689-48b5-bba6-de1649f87616 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:52.989753 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-62b09cb9-e689-48b5-bba6-de1649f87616 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:52.990662 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-62b09cb9-e689-48b5-bba6-de1649f87616 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:52.991122 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-62b09cb9-e689-48b5-bba6-de1649f87616 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:52.991576 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-62b09cb9-e689-48b5-bba6-de1649f87616 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:53.369163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-275f5149-f67b-4802-ad55-e58e65d96e16 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:53.369880 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-275f5149-f67b-4802-ad55-e58e65d96e16 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:53.376457 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-275f5149-f67b-4802-ad55-e58e65d96e16 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:53.376950 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-275f5149-f67b-4802-ad55-e58e65d96e16 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:53.377380 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-275f5149-f67b-4802-ad55-e58e65d96e16 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:53.378113 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-275f5149-f67b-4802-ad55-e58e65d96e16 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:53.378640 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-275f5149-f67b-4802-ad55-e58e65d96e16 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:53.379072 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-275f5149-f67b-4802-ad55-e58e65d96e16 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:53.411612 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:53:53.532451 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-275f5149-f67b-4802-ad55-e58e65d96e16 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9eee66bc32a4bf09c786f1227258c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b6e06859f24f798b222c646238b39d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:53.540774 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-275f5149-f67b-4802-ad55-e58e65d96e16 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 200 len: 1314 microversion: 2.1 time: 0.175691 Oct 30 00:53:53.541409 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 327/668] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:53 2022] GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:53:53.546277 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-209cba34-5389-4f71-8fa7-fb0d1c6645b0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:53.546882 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-209cba34-5389-4f71-8fa7-fb0d1c6645b0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:53.552825 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-209cba34-5389-4f71-8fa7-fb0d1c6645b0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:53.553303 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-209cba34-5389-4f71-8fa7-fb0d1c6645b0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:53.553732 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-209cba34-5389-4f71-8fa7-fb0d1c6645b0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:53.554421 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-209cba34-5389-4f71-8fa7-fb0d1c6645b0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:53.554872 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-209cba34-5389-4f71-8fa7-fb0d1c6645b0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:53.555294 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-209cba34-5389-4f71-8fa7-fb0d1c6645b0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:53.564302 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-62b09cb9-e689-48b5-bba6-de1649f87616 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "POST /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.588546 Oct 30 00:53:53.565249 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 342/669] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Oct 30 00:53:52 2022] POST /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17/os-volume_attachments => generated 194 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:53:53.571979 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-2776d359-1ff0-464c-a8d1-12a306048d44 req-eaae981c-9b8b-4c31-bb2e-180b1ba31bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc119c64-c007-4eff-8ccb-bd6de3dd57dc", "name": "network-vif-plugged", "status": "completed", "tag": "bdf9e24c-b177-426a-8caa-f4864bb19b70"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:53:53.582267 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-2776d359-1ff0-464c-a8d1-12a306048d44 req-eaae981c-9b8b-4c31-bb2e-180b1ba31bc7 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:53.582751 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-2776d359-1ff0-464c-a8d1-12a306048d44 req-eaae981c-9b8b-4c31-bb2e-180b1ba31bc7 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:53.583156 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-2776d359-1ff0-464c-a8d1-12a306048d44 req-eaae981c-9b8b-4c31-bb2e-180b1ba31bc7 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:53.596763 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-2776d359-1ff0-464c-a8d1-12a306048d44 req-eaae981c-9b8b-4c31-bb2e-180b1ba31bc7 service nova] Creating event network-vif-plugged:bdf9e24c-b177-426a-8caa-f4864bb19b70 for instance bc119c64-c007-4eff-8ccb-bd6de3dd57dc on hv-cinder-86149 Oct 30 00:53:53.603761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-2776d359-1ff0-464c-a8d1-12a306048d44 req-eaae981c-9b8b-4c31-bb2e-180b1ba31bc7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037041 Oct 30 00:53:53.604605 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 343/670] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:53:53.692266 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-209cba34-5389-4f71-8fa7-fb0d1c6645b0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:53.701815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-209cba34-5389-4f71-8fa7-fb0d1c6645b0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:53.703249 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-209cba34-5389-4f71-8fa7-fb0d1c6645b0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:53.704428 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-209cba34-5389-4f71-8fa7-fb0d1c6645b0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.161730 Oct 30 00:53:53.704986 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 328/671] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:53 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:54.566001 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4b0dbb03-bdeb-47ff-8b92-df9f8c1859a1 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:54.566701 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-4b0dbb03-bdeb-47ff-8b92-df9f8c1859a1 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:54.573128 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4b0dbb03-bdeb-47ff-8b92-df9f8c1859a1 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:54.573607 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4b0dbb03-bdeb-47ff-8b92-df9f8c1859a1 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:54.574039 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4b0dbb03-bdeb-47ff-8b92-df9f8c1859a1 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:54.574723 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4b0dbb03-bdeb-47ff-8b92-df9f8c1859a1 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:54.575171 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4b0dbb03-bdeb-47ff-8b92-df9f8c1859a1 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:54.575590 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4b0dbb03-bdeb-47ff-8b92-df9f8c1859a1 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:54.713398 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4b0dbb03-bdeb-47ff-8b92-df9f8c1859a1 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9eee66bc32a4bf09c786f1227258c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b6e06859f24f798b222c646238b39d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:54.720828 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-4b0dbb03-bdeb-47ff-8b92-df9f8c1859a1 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 200 len: 1314 microversion: 2.1 time: 0.159519 Oct 30 00:53:54.721378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 344/672] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:54 2022] GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:54.730198 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-01631df2-8e99-416f-834f-9285d8a9f5de tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:54.730797 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-01631df2-8e99-416f-834f-9285d8a9f5de tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:54.737221 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-01631df2-8e99-416f-834f-9285d8a9f5de tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:54.737703 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-01631df2-8e99-416f-834f-9285d8a9f5de tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:54.738129 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-01631df2-8e99-416f-834f-9285d8a9f5de tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:54.738808 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-01631df2-8e99-416f-834f-9285d8a9f5de tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:54.739450 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-01631df2-8e99-416f-834f-9285d8a9f5de tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:54.739928 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-01631df2-8e99-416f-834f-9285d8a9f5de tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:54.880126 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-01631df2-8e99-416f-834f-9285d8a9f5de tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:54.889696 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-01631df2-8e99-416f-834f-9285d8a9f5de tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:54.891577 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-01631df2-8e99-416f-834f-9285d8a9f5de tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:54.892798 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-01631df2-8e99-416f-834f-9285d8a9f5de tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.166425 Oct 30 00:53:54.893350 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 329/673] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:54 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:55.758552 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-268e2164-7a03-4eaa-82c7-b4a4a0a6f27c tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:55.759562 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-268e2164-7a03-4eaa-82c7-b4a4a0a6f27c tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:55.767375 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-268e2164-7a03-4eaa-82c7-b4a4a0a6f27c tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:55.768011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-268e2164-7a03-4eaa-82c7-b4a4a0a6f27c tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:55.768613 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-268e2164-7a03-4eaa-82c7-b4a4a0a6f27c tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:55.769442 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-268e2164-7a03-4eaa-82c7-b4a4a0a6f27c tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:55.770042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-268e2164-7a03-4eaa-82c7-b4a4a0a6f27c tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:55.770585 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-268e2164-7a03-4eaa-82c7-b4a4a0a6f27c tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:55.902833 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-268e2164-7a03-4eaa-82c7-b4a4a0a6f27c tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9eee66bc32a4bf09c786f1227258c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b6e06859f24f798b222c646238b39d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:55.911496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-268e2164-7a03-4eaa-82c7-b4a4a0a6f27c tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 200 len: 1314 microversion: 2.1 time: 0.171743 Oct 30 00:53:55.912283 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 345/674] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:55 2022] GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:55.918746 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-7ed28e07-bda0-44bf-a644-357cb41f9306 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:55.919489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-7ed28e07-bda0-44bf-a644-357cb41f9306 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:55.925985 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7ed28e07-bda0-44bf-a644-357cb41f9306 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:55.926579 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7ed28e07-bda0-44bf-a644-357cb41f9306 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:55.927230 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7ed28e07-bda0-44bf-a644-357cb41f9306 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:55.928715 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7ed28e07-bda0-44bf-a644-357cb41f9306 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:55.929103 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7ed28e07-bda0-44bf-a644-357cb41f9306 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:55.929598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7ed28e07-bda0-44bf-a644-357cb41f9306 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:56.062977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-7ed28e07-bda0-44bf-a644-357cb41f9306 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:56.072074 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-7ed28e07-bda0-44bf-a644-357cb41f9306 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:56.073776 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-7ed28e07-bda0-44bf-a644-357cb41f9306 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:56.074928 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-7ed28e07-bda0-44bf-a644-357cb41f9306 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1808 microversion: 2.20 time: 0.160010 Oct 30 00:53:56.075479 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 330/675] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:55 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:53:56.935273 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-a9782992-a74d-4380-abfd-30c07d999ed9 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:56.935880 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-a9782992-a74d-4380-abfd-30c07d999ed9 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:56.942269 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a9782992-a74d-4380-abfd-30c07d999ed9 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:56.942744 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a9782992-a74d-4380-abfd-30c07d999ed9 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:56.943176 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a9782992-a74d-4380-abfd-30c07d999ed9 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:56.943857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a9782992-a74d-4380-abfd-30c07d999ed9 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:56.945148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a9782992-a74d-4380-abfd-30c07d999ed9 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:56.945493 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a9782992-a74d-4380-abfd-30c07d999ed9 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:57.075998 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-a9782992-a74d-4380-abfd-30c07d999ed9 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9eee66bc32a4bf09c786f1227258c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b6e06859f24f798b222c646238b39d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:57.083484 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-a9782992-a74d-4380-abfd-30c07d999ed9 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 200 len: 1464 microversion: 2.1 time: 0.152182 Oct 30 00:53:57.084039 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 346/676] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:56 2022] GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:53:57.100863 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c9295f47-4766-41c8-965c-1511889d6aae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:57.101461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-c9295f47-4766-41c8-965c-1511889d6aae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:57.107921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c9295f47-4766-41c8-965c-1511889d6aae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:57.108438 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c9295f47-4766-41c8-965c-1511889d6aae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:57.108867 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c9295f47-4766-41c8-965c-1511889d6aae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:57.109553 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c9295f47-4766-41c8-965c-1511889d6aae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:57.109999 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c9295f47-4766-41c8-965c-1511889d6aae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:57.110413 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c9295f47-4766-41c8-965c-1511889d6aae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:57.129193 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-034c31d7-202b-4833-8567-c2de03107694 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:57.129682 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-034c31d7-202b-4833-8567-c2de03107694 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:57.136656 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-034c31d7-202b-4833-8567-c2de03107694 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:57.137132 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-034c31d7-202b-4833-8567-c2de03107694 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:57.137556 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-034c31d7-202b-4833-8567-c2de03107694 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:57.138232 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-034c31d7-202b-4833-8567-c2de03107694 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:57.138674 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-034c31d7-202b-4833-8567-c2de03107694 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:57.139143 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-034c31d7-202b-4833-8567-c2de03107694 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:57.165503 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-034c31d7-202b-4833-8567-c2de03107694 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Going to try to terminate instance {{(pid=125554) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 00:53:57.241148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c9295f47-4766-41c8-965c-1511889d6aae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:57.251225 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-034c31d7-202b-4833-8567-c2de03107694 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 204 len: 0 microversion: 2.1 time: 0.125545 Oct 30 00:53:57.251983 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 347/677] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 00:53:57 2022] DELETE /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 30 00:53:57.252194 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c9295f47-4766-41c8-965c-1511889d6aae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:57.254022 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c9295f47-4766-41c8-965c-1511889d6aae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:57.255662 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c9295f47-4766-41c8-965c-1511889d6aae tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1795 microversion: 2.20 time: 0.158574 Oct 30 00:53:57.268450 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 331/678] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:53:57 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1795 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:53:57.268620 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-59eb387b-7eac-43de-89f0-2356017061dd tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:57.268620 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-59eb387b-7eac-43de-89f0-2356017061dd tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:57.268620 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-59eb387b-7eac-43de-89f0-2356017061dd tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:57.268864 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-59eb387b-7eac-43de-89f0-2356017061dd tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:57.269312 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-59eb387b-7eac-43de-89f0-2356017061dd tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:57.270004 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-59eb387b-7eac-43de-89f0-2356017061dd tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:57.270450 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-59eb387b-7eac-43de-89f0-2356017061dd tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:57.270868 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-59eb387b-7eac-43de-89f0-2356017061dd tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:57.408593 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-59eb387b-7eac-43de-89f0-2356017061dd tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9eee66bc32a4bf09c786f1227258c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b6e06859f24f798b222c646238b39d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:57.416338 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-59eb387b-7eac-43de-89f0-2356017061dd tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 200 len: 1470 microversion: 2.1 time: 0.160155 Oct 30 00:53:57.416889 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 348/679] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:57 2022] GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:53:58.441387 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-87f95b2b-a50a-422f-bcef-8ce1d49693fe tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:58.441985 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-87f95b2b-a50a-422f-bcef-8ce1d49693fe tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:58.449325 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-87f95b2b-a50a-422f-bcef-8ce1d49693fe tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:58.449798 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-87f95b2b-a50a-422f-bcef-8ce1d49693fe tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:58.450221 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-87f95b2b-a50a-422f-bcef-8ce1d49693fe tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:58.450899 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-87f95b2b-a50a-422f-bcef-8ce1d49693fe tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:58.451345 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-87f95b2b-a50a-422f-bcef-8ce1d49693fe tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:58.451759 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-87f95b2b-a50a-422f-bcef-8ce1d49693fe tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:58.581215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-87f95b2b-a50a-422f-bcef-8ce1d49693fe tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9eee66bc32a4bf09c786f1227258c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b6e06859f24f798b222c646238b39d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:58.589904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-87f95b2b-a50a-422f-bcef-8ce1d49693fe tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 200 len: 1470 microversion: 2.1 time: 0.152352 Oct 30 00:53:58.590466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 332/680] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:58 2022] GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:53:59.612629 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-774ec995-ff31-4c6c-ac97-42bb43f97d7f tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:53:59.613237 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-774ec995-ff31-4c6c-ac97-42bb43f97d7f tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:53:59.619971 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-774ec995-ff31-4c6c-ac97-42bb43f97d7f tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:59.620487 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-774ec995-ff31-4c6c-ac97-42bb43f97d7f tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:59.620924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-774ec995-ff31-4c6c-ac97-42bb43f97d7f tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:59.621611 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-774ec995-ff31-4c6c-ac97-42bb43f97d7f tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:53:59.622063 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-774ec995-ff31-4c6c-ac97-42bb43f97d7f tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:53:59.622493 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-774ec995-ff31-4c6c-ac97-42bb43f97d7f tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:53:59.824014 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-774ec995-ff31-4c6c-ac97-42bb43f97d7f tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9eee66bc32a4bf09c786f1227258c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b6e06859f24f798b222c646238b39d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:53:59.831635 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-774ec995-ff31-4c6c-ac97-42bb43f97d7f tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 200 len: 1470 microversion: 2.1 time: 0.222872 Oct 30 00:53:59.832216 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 349/681] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:53:59 2022] GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 1470 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:54:00.190793 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-c7122496-0c43-4243-8858-cef4550f28cf req-343f5790-3041-4eb2-8e45-d6cdfd1184d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc119c64-c007-4eff-8ccb-bd6de3dd57dc", "name": "network-vif-deleted", "tag": "bdf9e24c-b177-426a-8caa-f4864bb19b70"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:54:00.201862 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-c7122496-0c43-4243-8858-cef4550f28cf req-343f5790-3041-4eb2-8e45-d6cdfd1184d5 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:00.202339 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-c7122496-0c43-4243-8858-cef4550f28cf req-343f5790-3041-4eb2-8e45-d6cdfd1184d5 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:00.202765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-c7122496-0c43-4243-8858-cef4550f28cf req-343f5790-3041-4eb2-8e45-d6cdfd1184d5 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:00.217568 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-c7122496-0c43-4243-8858-cef4550f28cf req-343f5790-3041-4eb2-8e45-d6cdfd1184d5 service nova] Creating event network-vif-deleted:bdf9e24c-b177-426a-8caa-f4864bb19b70 for instance bc119c64-c007-4eff-8ccb-bd6de3dd57dc on hv-cinder-86149 Oct 30 00:54:00.222586 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-c7122496-0c43-4243-8858-cef4550f28cf req-343f5790-3041-4eb2-8e45-d6cdfd1184d5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190671 Oct 30 00:54:00.223452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 333/682] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:54:00.857829 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-6be1579f-dbf7-4e9a-abc5-dda5b0f7f821 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:54:00.858471 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-6be1579f-dbf7-4e9a-abc5-dda5b0f7f821 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:54:00.865337 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6be1579f-dbf7-4e9a-abc5-dda5b0f7f821 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:00.865825 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6be1579f-dbf7-4e9a-abc5-dda5b0f7f821 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:00.866441 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6be1579f-dbf7-4e9a-abc5-dda5b0f7f821 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:00.867151 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6be1579f-dbf7-4e9a-abc5-dda5b0f7f821 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:00.867621 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6be1579f-dbf7-4e9a-abc5-dda5b0f7f821 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:00.868028 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6be1579f-dbf7-4e9a-abc5-dda5b0f7f821 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:00.902440 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6be1579f-dbf7-4e9a-abc5-dda5b0f7f821 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:00.903084 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6be1579f-dbf7-4e9a-abc5-dda5b0f7f821 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:00.903678 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6be1579f-dbf7-4e9a-abc5-dda5b0f7f821 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:00.904192 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.objects.instance [None req-6be1579f-dbf7-4e9a-abc5-dda5b0f7f821 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lazy-loading 'fault' on Instance uuid bc119c64-c007-4eff-8ccb-bd6de3dd57dc {{(pid=125554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:54:00.949212 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6be1579f-dbf7-4e9a-abc5-dda5b0f7f821 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9eee66bc32a4bf09c786f1227258c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b6e06859f24f798b222c646238b39d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:54:00.956771 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-6be1579f-dbf7-4e9a-abc5-dda5b0f7f821 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 200 len: 1304 microversion: 2.1 time: 0.105335 Oct 30 00:54:00.957380 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 350/683] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:54:00 2022] GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:54:01.984284 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a9fbaf52-ff62-4b6b-bd23-14fea5850e14 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:54:01.985041 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a9fbaf52-ff62-4b6b-bd23-14fea5850e14 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] [instance: bc119c64-c007-4eff-8ccb-bd6de3dd57dc] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:54:01.991223 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9fbaf52-ff62-4b6b-bd23-14fea5850e14 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:01.992070 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9fbaf52-ff62-4b6b-bd23-14fea5850e14 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:01.992853 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9fbaf52-ff62-4b6b-bd23-14fea5850e14 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:01.993823 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9fbaf52-ff62-4b6b-bd23-14fea5850e14 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:01.994276 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9fbaf52-ff62-4b6b-bd23-14fea5850e14 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:01.994699 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9fbaf52-ff62-4b6b-bd23-14fea5850e14 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:02.007878 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-a9fbaf52-ff62-4b6b-bd23-14fea5850e14 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] HTTP exception thrown: Instance bc119c64-c007-4eff-8ccb-bd6de3dd57dc could not be found. Oct 30 00:54:02.009557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a9fbaf52-ff62-4b6b-bd23-14fea5850e14 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Request method failure captured: Oct 30 00:54:02.009557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc HTTP/1.1 Oct 30 00:54:02.009557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 00:54:02.009557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 00:54:02.009557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 00:54:02.009557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 00:54:02.009557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 00:54:02.009557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 00:54:02.009557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 00:54:02.009557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 00:54:02.009557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXcsLqDTW_LjYsYMV-l9H9K9l_c3wuuuJ3dhWnWoY59XBX46FkmLzNl6f_U5xcPbSO7n31IS1Kg2apN4Cjh7b_lhg_BBHZKmDoLSCDsvIa2IhJlVuLt3mh4Ruaa3YNkg7-trSZz5JCClebLYiNmN0tCBfY58HNj20lHXwKnez_mLoJRs Oct 30 00:54:02.009557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 00:54:02.009557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 00:54:02.009557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 00:54:02.009557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 00:54:02.009557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 00:54:02.009557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 00:54:02.009557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: 12b6e06859f24f798b222c646238b39d Oct 30 00:54:02.009557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-VolumesNegativeTest-100257583 Oct 30 00:54:02.009557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 00:54:02.009557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 00:54:02.011240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_12b6e06859f24f798b222c646238b39d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/12b6e06859f24f798b222c646238b39d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/12b6e06859f24f798b222c646238b39d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/12b6e06859f24f798b222c646238b39d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:54:02.011240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-VolumesNegativeTest-100257583 Oct 30 00:54:02.011240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: 12b6e06859f24f798b222c646238b39d Oct 30 00:54:02.011240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-VolumesNegativeTest-100257583 Oct 30 00:54:02.011240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-VolumesNegativeTest-100257583-project Oct 30 00:54:02.011240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 00:54:02.011240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 00:54:02.011240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: d9eee66bc32a4bf09c786f1227258c62 Oct 30 00:54:02.011240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-VolumesNegativeTest-100257583-project Oct 30 00:54:02.011240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: > Oct 30 00:54:02.011240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Instance bc119c64-c007-4eff-8ccb-bd6de3dd57dc could not be found. Oct 30 00:54:02.011240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': 'bc119c64-c007-4eff-8ccb-bd6de3dd57dc'} Oct 30 00:54:02.012377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:54:02.012377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:54:02.012377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:54:02.012377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:54:02.012377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:54:02.012377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:54:02.012377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:54:02.012377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:54:02.012377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:54:02.012377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:54:02.012377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc119c64-c007-4eff-8ccb-bd6de3dd57dc could not be found. Oct 30 00:54:02.012377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:54:02.012377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:54:02.012377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:54:02.012377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:54:02.012377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:54:02.012377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:54:02.012377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:54:02.012377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:54:02.012377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:54:02.013838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:54:02.013838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 00:54:02.013838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 00:54:02.013838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:54:02.013838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:54:02.013838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:54:02.013838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:54:02.013838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc119c64-c007-4eff-8ccb-bd6de3dd57dc could not be found. Oct 30 00:54:02.013838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:54:02.013838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:54:02.013838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:54:02.013838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:54:02.013838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:54:02.013838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:54:02.013838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:54:02.013838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:54:02.013838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc119c64-c007-4eff-8ccb-bd6de3dd57dc could not be found. Oct 30 00:54:02.013838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:54:02.015205 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a9fbaf52-ff62-4b6b-bd23-14fea5850e14 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] Returning 404 to user: Instance bc119c64-c007-4eff-8ccb-bd6de3dd57dc could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:54:02.015205 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a9fbaf52-ff62-4b6b-bd23-14fea5850e14 tempest-VolumesNegativeTest-100257583 tempest-VolumesNegativeTest-100257583-project] 10.222.0.36 "GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc" status: 404 len: 111 microversion: 2.1 time: 0.032150 Oct 30 00:54:02.015205 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 334/684] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:54:01 2022] GET /compute/v2.1/servers/bc119c64-c007-4eff-8ccb-bd6de3dd57dc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 00:54:20.300733 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-edc63bf5-2432-41a6-af49-5c38982f245b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:54:20.301246 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-edc63bf5-2432-41a6-af49-5c38982f245b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:54:20.304247 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:20.304889 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:20.310565 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-edc63bf5-2432-41a6-af49-5c38982f245b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:20.311037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-edc63bf5-2432-41a6-af49-5c38982f245b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:20.311463 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-edc63bf5-2432-41a6-af49-5c38982f245b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:20.312175 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-edc63bf5-2432-41a6-af49-5c38982f245b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:20.312622 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-edc63bf5-2432-41a6-af49-5c38982f245b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:20.313035 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-edc63bf5-2432-41a6-af49-5c38982f245b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:20.393662 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.objects.instance [None req-edc63bf5-2432-41a6-af49-5c38982f245b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lazy-loading 'services' on Instance uuid 78677ee5-c3d5-404d-9755-4bffbba69f17 {{(pid=125554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:54:20.464220 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-edc63bf5-2432-41a6-af49-5c38982f245b tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "DELETE /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17/os-volume_attachments/5b730f4b-359f-4669-b451-b7018983b04c" status: 202 len: 0 microversion: 2.1 time: 0.167101 Oct 30 00:54:20.465369 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 351/685] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Oct 30 00:54:20 2022] DELETE /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17/os-volume_attachments/5b730f4b-359f-4669-b451-b7018983b04c => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 00:54:21.593448 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-0a482776-634e-4a40-baff-521a8cbdfca5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:54:21.593971 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-0a482776-634e-4a40-baff-521a8cbdfca5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:54:21.596071 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=17 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:21.596724 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=71 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:21.602941 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0a482776-634e-4a40-baff-521a8cbdfca5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:21.603421 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0a482776-634e-4a40-baff-521a8cbdfca5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:21.603857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0a482776-634e-4a40-baff-521a8cbdfca5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:21.604579 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0a482776-634e-4a40-baff-521a8cbdfca5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:21.605038 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0a482776-634e-4a40-baff-521a8cbdfca5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:21.606053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0a482776-634e-4a40-baff-521a8cbdfca5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:21.631515 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-0a482776-634e-4a40-baff-521a8cbdfca5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Going to try to terminate instance {{(pid=125553) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 00:54:21.707272 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-0a482776-634e-4a40-baff-521a8cbdfca5 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "DELETE /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17" status: 204 len: 0 microversion: 2.1 time: 0.117702 Oct 30 00:54:21.707902 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 335/686] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 00:54:21 2022] DELETE /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 00:54:21.718682 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ff7c7189-a2d6-4674-a757-474aa7b2cb2f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:54:21.719459 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ff7c7189-a2d6-4674-a757-474aa7b2cb2f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:54:21.726259 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ff7c7189-a2d6-4674-a757-474aa7b2cb2f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:21.726746 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ff7c7189-a2d6-4674-a757-474aa7b2cb2f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:21.727175 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ff7c7189-a2d6-4674-a757-474aa7b2cb2f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:21.727934 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ff7c7189-a2d6-4674-a757-474aa7b2cb2f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:21.728341 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ff7c7189-a2d6-4674-a757-474aa7b2cb2f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:21.728777 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ff7c7189-a2d6-4674-a757-474aa7b2cb2f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:21.858272 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ff7c7189-a2d6-4674-a757-474aa7b2cb2f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:54:21.865810 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ff7c7189-a2d6-4674-a757-474aa7b2cb2f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17" status: 200 len: 1513 microversion: 2.1 time: 0.152825 Oct 30 00:54:21.866373 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 352/687] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:54:21 2022] GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:54:22.889915 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-4cf7c560-3c3e-4d5b-841e-9522c9e406b9 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:54:22.890606 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-4cf7c560-3c3e-4d5b-841e-9522c9e406b9 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:54:22.896970 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4cf7c560-3c3e-4d5b-841e-9522c9e406b9 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:22.897445 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4cf7c560-3c3e-4d5b-841e-9522c9e406b9 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:22.897869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4cf7c560-3c3e-4d5b-841e-9522c9e406b9 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:22.898555 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4cf7c560-3c3e-4d5b-841e-9522c9e406b9 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:22.899006 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4cf7c560-3c3e-4d5b-841e-9522c9e406b9 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:22.899423 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4cf7c560-3c3e-4d5b-841e-9522c9e406b9 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:23.026541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-4cf7c560-3c3e-4d5b-841e-9522c9e406b9 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:54:23.034974 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-4cf7c560-3c3e-4d5b-841e-9522c9e406b9 tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17" status: 200 len: 1513 microversion: 2.1 time: 0.149524 Oct 30 00:54:23.035539 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 336/688] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:54:22 2022] GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:54:24.058361 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-52dfbee2-d839-4968-8549-ed25dcb53f8f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:54:24.059690 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-52dfbee2-d839-4968-8549-ed25dcb53f8f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:54:24.066179 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-52dfbee2-d839-4968-8549-ed25dcb53f8f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:24.066660 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-52dfbee2-d839-4968-8549-ed25dcb53f8f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:24.067096 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-52dfbee2-d839-4968-8549-ed25dcb53f8f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:24.067788 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-52dfbee2-d839-4968-8549-ed25dcb53f8f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:24.068268 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-52dfbee2-d839-4968-8549-ed25dcb53f8f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:24.068715 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-52dfbee2-d839-4968-8549-ed25dcb53f8f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:24.198184 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-52dfbee2-d839-4968-8549-ed25dcb53f8f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:54:24.206589 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-52dfbee2-d839-4968-8549-ed25dcb53f8f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17" status: 200 len: 1513 microversion: 2.1 time: 0.152043 Oct 30 00:54:24.207151 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 353/689] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:54:24 2022] GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:54:25.078611 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-511db815-e2f7-4f19-9435-840550666c35 req-466e1fa1-42aa-440d-ae0a-404166175c3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78677ee5-c3d5-404d-9755-4bffbba69f17", "name": "network-vif-deleted", "tag": "d8df880f-485f-466c-b270-d75d712bf3a6"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:54:25.097650 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-511db815-e2f7-4f19-9435-840550666c35 req-466e1fa1-42aa-440d-ae0a-404166175c3b service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:25.098340 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-511db815-e2f7-4f19-9435-840550666c35 req-466e1fa1-42aa-440d-ae0a-404166175c3b service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:25.098832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-511db815-e2f7-4f19-9435-840550666c35 req-466e1fa1-42aa-440d-ae0a-404166175c3b service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:25.116723 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-511db815-e2f7-4f19-9435-840550666c35 req-466e1fa1-42aa-440d-ae0a-404166175c3b service nova] Creating event network-vif-deleted:d8df880f-485f-466c-b270-d75d712bf3a6 for instance 78677ee5-c3d5-404d-9755-4bffbba69f17 on hv-cinder-86149 Oct 30 00:54:25.124045 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-511db815-e2f7-4f19-9435-840550666c35 req-466e1fa1-42aa-440d-ae0a-404166175c3b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052572 Oct 30 00:54:25.125135 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 337/690] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:54:25.231403 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b3eac799-6a33-4fda-930e-904b308d112f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:54:25.232020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-b3eac799-6a33-4fda-930e-904b308d112f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:54:25.238604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b3eac799-6a33-4fda-930e-904b308d112f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:25.239083 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b3eac799-6a33-4fda-930e-904b308d112f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:25.239524 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b3eac799-6a33-4fda-930e-904b308d112f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:25.240243 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b3eac799-6a33-4fda-930e-904b308d112f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:25.240694 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b3eac799-6a33-4fda-930e-904b308d112f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:25.241110 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b3eac799-6a33-4fda-930e-904b308d112f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:25.272337 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b3eac799-6a33-4fda-930e-904b308d112f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:25.272819 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b3eac799-6a33-4fda-930e-904b308d112f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:25.273250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b3eac799-6a33-4fda-930e-904b308d112f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:25.273694 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.objects.instance [None req-b3eac799-6a33-4fda-930e-904b308d112f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lazy-loading 'fault' on Instance uuid 78677ee5-c3d5-404d-9755-4bffbba69f17 {{(pid=125554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:54:25.320061 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b3eac799-6a33-4fda-930e-904b308d112f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b3fa11eb591443e85f7317b6dc9b304', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68d0e30075684bc9a0d40d779c1ad73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:54:25.328980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b3eac799-6a33-4fda-930e-904b308d112f tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17" status: 200 len: 1309 microversion: 2.1 time: 0.102007 Oct 30 00:54:25.329541 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 354/691] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:54:25 2022] GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:54:26.353930 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-9262d1e5-5ffc-4bb0-b7e5-5a0366d844fd tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:54:26.354658 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-9262d1e5-5ffc-4bb0-b7e5-5a0366d844fd tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] [instance: 78677ee5-c3d5-404d-9755-4bffbba69f17] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:54:26.361547 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9262d1e5-5ffc-4bb0-b7e5-5a0366d844fd tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:26.362293 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9262d1e5-5ffc-4bb0-b7e5-5a0366d844fd tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:26.362744 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9262d1e5-5ffc-4bb0-b7e5-5a0366d844fd tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:26.363434 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9262d1e5-5ffc-4bb0-b7e5-5a0366d844fd tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:26.363888 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9262d1e5-5ffc-4bb0-b7e5-5a0366d844fd tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:26.364336 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9262d1e5-5ffc-4bb0-b7e5-5a0366d844fd tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:26.379410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-9262d1e5-5ffc-4bb0-b7e5-5a0366d844fd tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] HTTP exception thrown: Instance 78677ee5-c3d5-404d-9755-4bffbba69f17 could not be found. Oct 30 00:54:26.381148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-9262d1e5-5ffc-4bb0-b7e5-5a0366d844fd tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Request method failure captured: Oct 30 00:54:26.381148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17 HTTP/1.1 Oct 30 00:54:26.381148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 00:54:26.381148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 00:54:26.381148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 00:54:26.381148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 00:54:26.381148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 00:54:26.381148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 00:54:26.381148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 00:54:26.381148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 00:54:26.381148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXcqdPoW3kvkIDqmKOnraL5knGL9vGnOOuvhRZW3ELN1zTOyd7h8Kfe2t-Ylf0rkYJiHl4DhX7pVUzzazK-04EeDlloJo6ZVyjlgnW6GGYG0wYS519KEGyPmh6ItdVrdKNPmNhqb4LsVePG6cHGQ-TuGyoQ0t58rmMPQiCOPG-U8-ijU Oct 30 00:54:26.381148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 00:54:26.381148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 00:54:26.381148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 00:54:26.381148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 00:54:26.381148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 00:54:26.381148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 00:54:26.381148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: 68d0e30075684bc9a0d40d779c1ad73f Oct 30 00:54:26.381148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2078867247 Oct 30 00:54:26.381148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 00:54:26.381148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 00:54:26.382739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_68d0e30075684bc9a0d40d779c1ad73f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/68d0e30075684bc9a0d40d779c1ad73f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/68d0e30075684bc9a0d40d779c1ad73f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/68d0e30075684bc9a0d40d779c1ad73f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:54:26.382739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-VolumesSnapshotTestJSON-2078867247 Oct 30 00:54:26.382739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: 68d0e30075684bc9a0d40d779c1ad73f Oct 30 00:54:26.382739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2078867247 Oct 30 00:54:26.382739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-VolumesSnapshotTestJSON-2078867247-project Oct 30 00:54:26.382739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 00:54:26.382739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 00:54:26.382739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: 4b3fa11eb591443e85f7317b6dc9b304 Oct 30 00:54:26.382739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-VolumesSnapshotTestJSON-2078867247-project Oct 30 00:54:26.382739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: > Oct 30 00:54:26.382739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Instance 78677ee5-c3d5-404d-9755-4bffbba69f17 could not be found. Oct 30 00:54:26.382739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': '78677ee5-c3d5-404d-9755-4bffbba69f17'} Oct 30 00:54:26.383582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:54:26.383582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:54:26.383582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:54:26.383582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:54:26.383582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:54:26.383582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:54:26.383582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:54:26.383582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:54:26.383582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:54:26.383582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:54:26.383582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78677ee5-c3d5-404d-9755-4bffbba69f17 could not be found. Oct 30 00:54:26.383582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:54:26.383582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:54:26.383582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:54:26.383582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:54:26.383582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:54:26.383582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:54:26.383582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:54:26.383582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:54:26.383582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:54:26.385053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:54:26.385053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 00:54:26.385053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 00:54:26.385053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:54:26.385053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:54:26.385053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:54:26.385053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:54:26.385053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78677ee5-c3d5-404d-9755-4bffbba69f17 could not be found. Oct 30 00:54:26.385053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:54:26.385053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:54:26.385053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:54:26.385053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:54:26.385053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:54:26.385053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:54:26.385053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:54:26.385053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:54:26.385053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78677ee5-c3d5-404d-9755-4bffbba69f17 could not be found. Oct 30 00:54:26.385053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:54:26.386153 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-9262d1e5-5ffc-4bb0-b7e5-5a0366d844fd tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] Returning 404 to user: Instance 78677ee5-c3d5-404d-9755-4bffbba69f17 could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:54:26.386153 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-9262d1e5-5ffc-4bb0-b7e5-5a0366d844fd tempest-VolumesSnapshotTestJSON-2078867247 tempest-VolumesSnapshotTestJSON-2078867247-project] 10.222.0.36 "GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17" status: 404 len: 111 microversion: 2.1 time: 0.033253 Oct 30 00:54:26.386153 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 338/692] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:54:26 2022] GET /compute/v2.1/servers/78677ee5-c3d5-404d-9755-4bffbba69f17 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 00:54:38.432733 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=10 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:38.433461 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:38.654688 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-8693ca4d-f22d-4bd6-92f5-af309c7c793c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "362ec2dd-f777-4ee1-9943-7f3d1eb624e2"}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:54:38.657141 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-8693ca4d-f22d-4bd6-92f5-af309c7c793c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:54:38.663060 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8693ca4d-f22d-4bd6-92f5-af309c7c793c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:38.663536 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8693ca4d-f22d-4bd6-92f5-af309c7c793c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:38.663969 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8693ca4d-f22d-4bd6-92f5-af309c7c793c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:38.664696 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8693ca4d-f22d-4bd6-92f5-af309c7c793c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:38.665144 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8693ca4d-f22d-4bd6-92f5-af309c7c793c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:38.665606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8693ca4d-f22d-4bd6-92f5-af309c7c793c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:40.878105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-8693ca4d-f22d-4bd6-92f5-af309c7c793c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "POST /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.450273 Oct 30 00:54:40.878718 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 355/693] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Oct 30 00:54:38 2022] POST /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656/os-volume_attachments => generated 194 bytes in 2452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:54:48.423875 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1c6c4652-862f-4f0a-a7b7-b2387bec78b7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:54:48.426083 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1c6c4652-862f-4f0a-a7b7-b2387bec78b7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:54:48.428208 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:48.428862 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:54:48.435678 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1c6c4652-862f-4f0a-a7b7-b2387bec78b7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:48.436213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1c6c4652-862f-4f0a-a7b7-b2387bec78b7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:48.436654 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1c6c4652-862f-4f0a-a7b7-b2387bec78b7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:48.437369 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1c6c4652-862f-4f0a-a7b7-b2387bec78b7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:48.437844 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1c6c4652-862f-4f0a-a7b7-b2387bec78b7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:48.438269 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1c6c4652-862f-4f0a-a7b7-b2387bec78b7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:48.465038 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.objects.instance [None req-1c6c4652-862f-4f0a-a7b7-b2387bec78b7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lazy-loading 'flavor' on Instance uuid a3538515-fbfd-4f28-bc94-dd5e63e10656 {{(pid=125553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:54:48.592492 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1c6c4652-862f-4f0a-a7b7-b2387bec78b7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "POST /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656/action" status: 200 len: 32 microversion: 2.1 time: 0.173411 Oct 30 00:54:48.593096 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 339/694] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Oct 30 00:54:48 2022] POST /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 00:54:48.604322 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-8468aa4a-0ead-41ba-a1f3-bc94a78e5e55 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:54:48.605009 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-8468aa4a-0ead-41ba-a1f3-bc94a78e5e55 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:54:48.612064 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8468aa4a-0ead-41ba-a1f3-bc94a78e5e55 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:48.612854 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8468aa4a-0ead-41ba-a1f3-bc94a78e5e55 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:48.613294 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8468aa4a-0ead-41ba-a1f3-bc94a78e5e55 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:48.614036 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8468aa4a-0ead-41ba-a1f3-bc94a78e5e55 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:48.614538 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8468aa4a-0ead-41ba-a1f3-bc94a78e5e55 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:48.614912 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8468aa4a-0ead-41ba-a1f3-bc94a78e5e55 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:48.834509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-8468aa4a-0ead-41ba-a1f3-bc94a78e5e55 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:54:48.842840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-8468aa4a-0ead-41ba-a1f3-bc94a78e5e55 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1734 microversion: 2.1 time: 0.243730 Oct 30 00:54:48.843487 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 356/695] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:54:48 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1734 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:54:49.867106 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-bf054468-9b9f-437e-a36a-a8c99ffc5578 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:54:49.867802 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-bf054468-9b9f-437e-a36a-a8c99ffc5578 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:54:49.874255 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bf054468-9b9f-437e-a36a-a8c99ffc5578 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:49.874797 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bf054468-9b9f-437e-a36a-a8c99ffc5578 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:49.875150 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bf054468-9b9f-437e-a36a-a8c99ffc5578 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:49.875839 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bf054468-9b9f-437e-a36a-a8c99ffc5578 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:49.876311 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bf054468-9b9f-437e-a36a-a8c99ffc5578 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:49.876730 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bf054468-9b9f-437e-a36a-a8c99ffc5578 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:50.008638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-bf054468-9b9f-437e-a36a-a8c99ffc5578 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:54:50.017253 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-bf054468-9b9f-437e-a36a-a8c99ffc5578 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1734 microversion: 2.1 time: 0.154821 Oct 30 00:54:50.017807 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 340/696] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:54:49 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:54:51.041200 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-00911653-c569-43c6-979b-025d3d2c4673 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:54:51.041798 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-00911653-c569-43c6-979b-025d3d2c4673 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:54:51.049413 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-00911653-c569-43c6-979b-025d3d2c4673 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:51.049887 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-00911653-c569-43c6-979b-025d3d2c4673 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:51.050337 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-00911653-c569-43c6-979b-025d3d2c4673 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:51.051002 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-00911653-c569-43c6-979b-025d3d2c4673 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:51.051443 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-00911653-c569-43c6-979b-025d3d2c4673 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:51.051860 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-00911653-c569-43c6-979b-025d3d2c4673 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:51.184844 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-00911653-c569-43c6-979b-025d3d2c4673 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:54:51.192915 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-00911653-c569-43c6-979b-025d3d2c4673 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1734 microversion: 2.1 time: 0.155568 Oct 30 00:54:51.193491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 357/697] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:54:51 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:54:52.221109 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-fc919678-69c3-4175-a7d2-c75d684f152d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:54:52.221738 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-fc919678-69c3-4175-a7d2-c75d684f152d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:54:52.228714 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fc919678-69c3-4175-a7d2-c75d684f152d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:52.229586 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fc919678-69c3-4175-a7d2-c75d684f152d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:52.230414 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fc919678-69c3-4175-a7d2-c75d684f152d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:52.231120 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fc919678-69c3-4175-a7d2-c75d684f152d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:52.232437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fc919678-69c3-4175-a7d2-c75d684f152d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:52.232869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fc919678-69c3-4175-a7d2-c75d684f152d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:52.376180 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fc919678-69c3-4175-a7d2-c75d684f152d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:54:52.384789 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-fc919678-69c3-4175-a7d2-c75d684f152d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1734 microversion: 2.1 time: 0.172206 Oct 30 00:54:52.385516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 341/698] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:54:52 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:54:53.409324 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-1cc5a617-2c6e-4d50-bb93-6036d33dd5f1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:54:53.409970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-1cc5a617-2c6e-4d50-bb93-6036d33dd5f1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:54:53.416430 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1cc5a617-2c6e-4d50-bb93-6036d33dd5f1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:53.416907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1cc5a617-2c6e-4d50-bb93-6036d33dd5f1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:53.417341 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1cc5a617-2c6e-4d50-bb93-6036d33dd5f1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:53.418056 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1cc5a617-2c6e-4d50-bb93-6036d33dd5f1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:53.418504 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1cc5a617-2c6e-4d50-bb93-6036d33dd5f1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:53.419502 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1cc5a617-2c6e-4d50-bb93-6036d33dd5f1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:53.546278 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-1cc5a617-2c6e-4d50-bb93-6036d33dd5f1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:54:53.554565 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-1cc5a617-2c6e-4d50-bb93-6036d33dd5f1 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1734 microversion: 2.1 time: 0.149168 Oct 30 00:54:53.555132 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 358/699] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:54:53 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:54:54.578168 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-ddff415c-a468-40b2-a00d-6a9c59b6a717 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:54:54.578857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-ddff415c-a468-40b2-a00d-6a9c59b6a717 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:54:54.585289 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ddff415c-a468-40b2-a00d-6a9c59b6a717 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:54.585770 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ddff415c-a468-40b2-a00d-6a9c59b6a717 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:54.586203 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ddff415c-a468-40b2-a00d-6a9c59b6a717 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:54.586889 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ddff415c-a468-40b2-a00d-6a9c59b6a717 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:54.587338 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ddff415c-a468-40b2-a00d-6a9c59b6a717 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:54.587755 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ddff415c-a468-40b2-a00d-6a9c59b6a717 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:54.719183 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ddff415c-a468-40b2-a00d-6a9c59b6a717 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:54:54.727594 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-ddff415c-a468-40b2-a00d-6a9c59b6a717 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1734 microversion: 2.1 time: 0.153928 Oct 30 00:54:54.728161 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 342/700] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:54:54 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:54:55.751678 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-407a216b-6eed-41db-a53b-1781e8311c67 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:54:55.752311 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-407a216b-6eed-41db-a53b-1781e8311c67 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:54:55.758587 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-407a216b-6eed-41db-a53b-1781e8311c67 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:55.759067 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-407a216b-6eed-41db-a53b-1781e8311c67 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:55.759505 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-407a216b-6eed-41db-a53b-1781e8311c67 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:55.760448 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-407a216b-6eed-41db-a53b-1781e8311c67 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:55.760903 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-407a216b-6eed-41db-a53b-1781e8311c67 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:55.761322 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-407a216b-6eed-41db-a53b-1781e8311c67 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:55.889473 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-407a216b-6eed-41db-a53b-1781e8311c67 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:54:55.897830 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-407a216b-6eed-41db-a53b-1781e8311c67 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1734 microversion: 2.1 time: 0.149973 Oct 30 00:54:55.898394 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 359/701] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:54:55 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:54:56.922425 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d6b81366-71a3-45ec-887b-8a04d28b75b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:54:56.922957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d6b81366-71a3-45ec-887b-8a04d28b75b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:54:56.929365 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d6b81366-71a3-45ec-887b-8a04d28b75b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:56.929838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d6b81366-71a3-45ec-887b-8a04d28b75b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:56.930266 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d6b81366-71a3-45ec-887b-8a04d28b75b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:56.930944 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d6b81366-71a3-45ec-887b-8a04d28b75b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:56.931389 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d6b81366-71a3-45ec-887b-8a04d28b75b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:56.931805 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d6b81366-71a3-45ec-887b-8a04d28b75b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:57.058612 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d6b81366-71a3-45ec-887b-8a04d28b75b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:54:57.067948 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d6b81366-71a3-45ec-887b-8a04d28b75b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1734 microversion: 2.1 time: 0.150245 Oct 30 00:54:57.068530 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 343/702] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:54:56 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:54:58.092347 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c5db265b-8445-4a59-a9d9-e47b89a3aa80 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:54:58.093143 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c5db265b-8445-4a59-a9d9-e47b89a3aa80 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:54:58.099402 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c5db265b-8445-4a59-a9d9-e47b89a3aa80 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:58.099884 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c5db265b-8445-4a59-a9d9-e47b89a3aa80 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:58.100344 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c5db265b-8445-4a59-a9d9-e47b89a3aa80 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:58.101038 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c5db265b-8445-4a59-a9d9-e47b89a3aa80 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:58.101487 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c5db265b-8445-4a59-a9d9-e47b89a3aa80 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:58.101922 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c5db265b-8445-4a59-a9d9-e47b89a3aa80 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:58.230274 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c5db265b-8445-4a59-a9d9-e47b89a3aa80 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:54:58.238398 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c5db265b-8445-4a59-a9d9-e47b89a3aa80 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1734 microversion: 2.1 time: 0.150766 Oct 30 00:54:58.238954 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 360/703] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:54:58 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:54:59.261648 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e677814d-50cb-46fb-b7ab-203186c51513 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:54:59.262249 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-e677814d-50cb-46fb-b7ab-203186c51513 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:54:59.268986 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e677814d-50cb-46fb-b7ab-203186c51513 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:59.269499 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e677814d-50cb-46fb-b7ab-203186c51513 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:59.269928 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e677814d-50cb-46fb-b7ab-203186c51513 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:59.270652 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e677814d-50cb-46fb-b7ab-203186c51513 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:54:59.271102 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e677814d-50cb-46fb-b7ab-203186c51513 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:54:59.271522 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e677814d-50cb-46fb-b7ab-203186c51513 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:54:59.399925 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-e677814d-50cb-46fb-b7ab-203186c51513 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:54:59.408516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e677814d-50cb-46fb-b7ab-203186c51513 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1734 microversion: 2.1 time: 0.150609 Oct 30 00:54:59.409067 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 344/704] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:54:59 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:55:00.431965 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2fa55e97-e021-44d4-bffa-e28854e78da4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:00.432621 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2fa55e97-e021-44d4-bffa-e28854e78da4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:00.440040 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2fa55e97-e021-44d4-bffa-e28854e78da4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:00.440548 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2fa55e97-e021-44d4-bffa-e28854e78da4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:00.440979 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2fa55e97-e021-44d4-bffa-e28854e78da4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:00.441660 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2fa55e97-e021-44d4-bffa-e28854e78da4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:00.442106 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2fa55e97-e021-44d4-bffa-e28854e78da4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:00.442523 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2fa55e97-e021-44d4-bffa-e28854e78da4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:00.571607 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2fa55e97-e021-44d4-bffa-e28854e78da4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:00.580199 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2fa55e97-e021-44d4-bffa-e28854e78da4 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1734 microversion: 2.1 time: 0.152021 Oct 30 00:55:00.580765 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 361/705] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:55:00 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:55:01.605241 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5a99da51-f067-4266-8e1b-6307bf380b5a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:01.605851 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5a99da51-f067-4266-8e1b-6307bf380b5a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:01.612887 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a99da51-f067-4266-8e1b-6307bf380b5a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:01.613384 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a99da51-f067-4266-8e1b-6307bf380b5a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:01.613814 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a99da51-f067-4266-8e1b-6307bf380b5a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:01.614521 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a99da51-f067-4266-8e1b-6307bf380b5a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:01.614978 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a99da51-f067-4266-8e1b-6307bf380b5a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:01.615401 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a99da51-f067-4266-8e1b-6307bf380b5a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:01.764633 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5a99da51-f067-4266-8e1b-6307bf380b5a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:01.774125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5a99da51-f067-4266-8e1b-6307bf380b5a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1734 microversion: 2.1 time: 0.173844 Oct 30 00:55:01.775450 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 345/706] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:55:01 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:55:02.799181 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-bc5adeda-0323-4ded-b48f-8132f6bebdc7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:02.799846 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-bc5adeda-0323-4ded-b48f-8132f6bebdc7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:02.811462 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bc5adeda-0323-4ded-b48f-8132f6bebdc7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:02.811462 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bc5adeda-0323-4ded-b48f-8132f6bebdc7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:02.811462 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bc5adeda-0323-4ded-b48f-8132f6bebdc7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:02.811462 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bc5adeda-0323-4ded-b48f-8132f6bebdc7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:02.811915 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bc5adeda-0323-4ded-b48f-8132f6bebdc7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:02.811915 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bc5adeda-0323-4ded-b48f-8132f6bebdc7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:02.955624 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-bc5adeda-0323-4ded-b48f-8132f6bebdc7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:02.967466 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-bc5adeda-0323-4ded-b48f-8132f6bebdc7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1734 microversion: 2.1 time: 0.172059 Oct 30 00:55:02.968388 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 362/707] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:55:02 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:55:03.993261 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-2c02f689-c081-48fe-9ef8-877521512f1a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:03.993962 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-2c02f689-c081-48fe-9ef8-877521512f1a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:04.000729 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2c02f689-c081-48fe-9ef8-877521512f1a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:04.001198 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2c02f689-c081-48fe-9ef8-877521512f1a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:04.001646 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2c02f689-c081-48fe-9ef8-877521512f1a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:04.002337 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2c02f689-c081-48fe-9ef8-877521512f1a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:04.002789 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2c02f689-c081-48fe-9ef8-877521512f1a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:04.003213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2c02f689-c081-48fe-9ef8-877521512f1a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:04.130871 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-2c02f689-c081-48fe-9ef8-877521512f1a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:04.139454 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-2c02f689-c081-48fe-9ef8-877521512f1a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1714 microversion: 2.1 time: 0.150595 Oct 30 00:55:04.140006 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 346/708] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:55:03 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:55:04.247141 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-72c75224-87c3-4228-a350-09792d83ab68 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:04.247933 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-72c75224-87c3-4228-a350-09792d83ab68 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:04.254141 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-72c75224-87c3-4228-a350-09792d83ab68 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:04.254616 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-72c75224-87c3-4228-a350-09792d83ab68 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:04.255047 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-72c75224-87c3-4228-a350-09792d83ab68 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:04.255730 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-72c75224-87c3-4228-a350-09792d83ab68 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:04.256217 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-72c75224-87c3-4228-a350-09792d83ab68 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:04.256637 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-72c75224-87c3-4228-a350-09792d83ab68 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:04.336380 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-72c75224-87c3-4228-a350-09792d83ab68 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] HTTP exception thrown: Cannot 'detach_volume' instance a3538515-fbfd-4f28-bc94-dd5e63e10656 while it is in vm_state rescued Oct 30 00:55:04.338029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-72c75224-87c3-4228-a350-09792d83ab68 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Request method failure captured: Oct 30 00:55:04.338029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: DELETE /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656/os-volume_attachments/362ec2dd-f777-4ee1-9943-7f3d1eb624e2 HTTP/1.1 Oct 30 00:55:04.338029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 00:55:04.338029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 00:55:04.338029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 00:55:04.338029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 00:55:04.338029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 00:55:04.338029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 00:55:04.338029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 00:55:04.338029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 00:55:04.338029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcncHN2FMp3GekPAJgW2lCHVpFVD1HiGRi_JOqMmQ-PfVilNLgfwWcxx70_iLo4vYd7UAj8igq__hURJYEWmtmOEe5lhexivbbch2YCwcd0s6St00YrnBHRVHxJNmHDYhZsFh2ymNYkM6Kt17ecfK_bdNW7N1EoLE8TulhKSa2LJfPY Oct 30 00:55:04.338029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 00:55:04.338029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 00:55:04.338029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 00:55:04.338029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 00:55:04.338029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 00:55:04.338029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 00:55:04.338029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: 999d27163d544dff836ab7d90355f0d6 Oct 30 00:55:04.338029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-661451104 Oct 30 00:55:04.338029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 00:55:04.338029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 00:55:04.339642 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_999d27163d544dff836ab7d90355f0d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/999d27163d544dff836ab7d90355f0d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/999d27163d544dff836ab7d90355f0d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/999d27163d544dff836ab7d90355f0d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:55:04.339642 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-ServerRescueNegativeTestJSON-661451104 Oct 30 00:55:04.339642 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: 999d27163d544dff836ab7d90355f0d6 Oct 30 00:55:04.339642 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-661451104 Oct 30 00:55:04.339642 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-ServerRescueNegativeTestJSON-661451104-project Oct 30 00:55:04.339642 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 00:55:04.339642 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 00:55:04.339642 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 350f5e4238f448949b2c372aabbfc835 Oct 30 00:55:04.339642 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-ServerRescueNegativeTestJSON-661451104-project Oct 30 00:55:04.339642 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 00:55:04.339642 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Cannot 'detach_volume' instance a3538515-fbfd-4f28-bc94-dd5e63e10656 while it is in vm_state rescued Oct 30 00:55:04.341931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'server_id': 'a3538515-fbfd-4f28-bc94-dd5e63e10656', 'id': '362ec2dd-f777-4ee1-9943-7f3d1eb624e2'} Oct 30 00:55:04.341931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:55:04.341931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:55:04.341931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 30 00:55:04.341931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 30 00:55:04.341931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 00:55:04.341931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 00:55:04.341931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 30 00:55:04.341931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 30 00:55:04.341931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a3538515-fbfd-4f28-bc94-dd5e63e10656 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 30 00:55:04.341931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:55:04.341931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:55:04.341931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:55:04.341931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:55:04.341931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:55:04.341931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:55:04.341931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:55:04.341931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:55:04.341931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:55:04.341931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:55:04.343469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 30 00:55:04.343469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 30 00:55:04.343469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 30 00:55:04.343469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 30 00:55:04.343469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a3538515-fbfd-4f28-bc94-dd5e63e10656 while it is in vm_state rescued Oct 30 00:55:04.343469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:55:04.343469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:55:04.343469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:55:04.343469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:55:04.343469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:55:04.343469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:55:04.343469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:55:04.343469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:55:04.343469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a3538515-fbfd-4f28-bc94-dd5e63e10656 while it is in vm_state rescued Oct 30 00:55:04.343469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:55:04.343469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-72c75224-87c3-4228-a350-09792d83ab68 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Returning 409 to user: Cannot 'detach_volume' instance a3538515-fbfd-4f28-bc94-dd5e63e10656 while it is in vm_state rescued {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:55:04.344710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-72c75224-87c3-4228-a350-09792d83ab68 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656/os-volume_attachments/362ec2dd-f777-4ee1-9943-7f3d1eb624e2" status: 409 len: 152 microversion: 2.1 time: 0.096214 Oct 30 00:55:04.344710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 363/709] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Oct 30 00:55:04 2022] DELETE /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656/os-volume_attachments/362ec2dd-f777-4ee1-9943-7f3d1eb624e2 => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 30 00:55:04.349100 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3139d4ac-ed83-40e3-9831-7127460b5d9a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:55:04.349635 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-3139d4ac-ed83-40e3-9831-7127460b5d9a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:04.355384 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3139d4ac-ed83-40e3-9831-7127460b5d9a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:04.355867 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3139d4ac-ed83-40e3-9831-7127460b5d9a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:04.356344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3139d4ac-ed83-40e3-9831-7127460b5d9a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:04.357148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3139d4ac-ed83-40e3-9831-7127460b5d9a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:04.357796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3139d4ac-ed83-40e3-9831-7127460b5d9a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:04.358223 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3139d4ac-ed83-40e3-9831-7127460b5d9a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:04.425675 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-3139d4ac-ed83-40e3-9831-7127460b5d9a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "POST /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656/action" status: 202 len: 0 microversion: 2.1 time: 0.080181 Oct 30 00:55:04.426313 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 347/710] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Oct 30 00:55:04 2022] POST /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 00:55:04.434655 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b943e522-97a6-4db3-90d5-fd4ff8814d3a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:04.435772 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-b943e522-97a6-4db3-90d5-fd4ff8814d3a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:04.441754 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b943e522-97a6-4db3-90d5-fd4ff8814d3a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:04.442216 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b943e522-97a6-4db3-90d5-fd4ff8814d3a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:04.442731 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b943e522-97a6-4db3-90d5-fd4ff8814d3a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:04.443524 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b943e522-97a6-4db3-90d5-fd4ff8814d3a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:04.444215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b943e522-97a6-4db3-90d5-fd4ff8814d3a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:04.444646 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b943e522-97a6-4db3-90d5-fd4ff8814d3a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:04.880475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b943e522-97a6-4db3-90d5-fd4ff8814d3a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:04.888946 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b943e522-97a6-4db3-90d5-fd4ff8814d3a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1722 microversion: 2.1 time: 0.458171 Oct 30 00:55:04.889703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 364/711] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:55:04 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1722 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:55:05.913126 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-ea596eb3-3f99-4ed9-b438-2fae3d6e4093 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:05.913848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-ea596eb3-3f99-4ed9-b438-2fae3d6e4093 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:05.920524 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea596eb3-3f99-4ed9-b438-2fae3d6e4093 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:05.921012 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea596eb3-3f99-4ed9-b438-2fae3d6e4093 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:05.921448 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea596eb3-3f99-4ed9-b438-2fae3d6e4093 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:05.922146 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea596eb3-3f99-4ed9-b438-2fae3d6e4093 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:05.922601 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea596eb3-3f99-4ed9-b438-2fae3d6e4093 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:05.923027 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea596eb3-3f99-4ed9-b438-2fae3d6e4093 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:06.052131 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ea596eb3-3f99-4ed9-b438-2fae3d6e4093 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:06.061069 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-ea596eb3-3f99-4ed9-b438-2fae3d6e4093 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1722 microversion: 2.1 time: 0.152361 Oct 30 00:55:06.061628 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 348/712] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:55:05 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:55:07.084240 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-35598bc6-25a2-41f2-a1f3-40f3bdb4b939 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:07.084849 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-35598bc6-25a2-41f2-a1f3-40f3bdb4b939 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:07.091971 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-35598bc6-25a2-41f2-a1f3-40f3bdb4b939 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:07.092615 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-35598bc6-25a2-41f2-a1f3-40f3bdb4b939 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:07.093053 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-35598bc6-25a2-41f2-a1f3-40f3bdb4b939 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:07.093743 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-35598bc6-25a2-41f2-a1f3-40f3bdb4b939 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:07.094194 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-35598bc6-25a2-41f2-a1f3-40f3bdb4b939 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:07.094616 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-35598bc6-25a2-41f2-a1f3-40f3bdb4b939 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:07.230174 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-35598bc6-25a2-41f2-a1f3-40f3bdb4b939 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:07.238654 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-35598bc6-25a2-41f2-a1f3-40f3bdb4b939 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1722 microversion: 2.1 time: 0.158320 Oct 30 00:55:07.239203 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 365/713] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:55:07 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:55:08.262307 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-8f8dcdfc-d963-4c52-90b4-cf11efec70b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:08.262910 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-8f8dcdfc-d963-4c52-90b4-cf11efec70b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:08.269940 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8f8dcdfc-d963-4c52-90b4-cf11efec70b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:08.270419 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8f8dcdfc-d963-4c52-90b4-cf11efec70b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:08.270848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8f8dcdfc-d963-4c52-90b4-cf11efec70b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:08.271537 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8f8dcdfc-d963-4c52-90b4-cf11efec70b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:08.271989 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8f8dcdfc-d963-4c52-90b4-cf11efec70b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:08.272436 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8f8dcdfc-d963-4c52-90b4-cf11efec70b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:08.405680 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8f8dcdfc-d963-4c52-90b4-cf11efec70b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:08.413844 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-8f8dcdfc-d963-4c52-90b4-cf11efec70b6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1728 microversion: 2.1 time: 0.155462 Oct 30 00:55:08.414401 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 349/714] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:55:08 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:55:08.437367 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-45cfbee6-942f-4ad5-a589-b4a9b66a9f1e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:08.437964 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-45cfbee6-942f-4ad5-a589-b4a9b66a9f1e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:08.440363 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=23 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:08.445650 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-45cfbee6-942f-4ad5-a589-b4a9b66a9f1e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:08.446124 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-45cfbee6-942f-4ad5-a589-b4a9b66a9f1e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:08.446554 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-45cfbee6-942f-4ad5-a589-b4a9b66a9f1e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:08.447238 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-45cfbee6-942f-4ad5-a589-b4a9b66a9f1e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:08.447733 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-45cfbee6-942f-4ad5-a589-b4a9b66a9f1e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:08.448175 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-45cfbee6-942f-4ad5-a589-b4a9b66a9f1e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:08.452879 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:08.527166 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-45cfbee6-942f-4ad5-a589-b4a9b66a9f1e tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094864 Oct 30 00:55:08.527752 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 366/715] 10.222.0.36 () {58 vars in 1275 bytes} [Sun Oct 30 00:55:08 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:55:09.404436 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-a22fec61-6e2a-40ee-9611-e5e046ecf339 req-5910ef62-3049-407a-889a-54e984a8edc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3538515-fbfd-4f28-bc94-dd5e63e10656", "tag": "8a1c5189-8d93-4813-95d3-4fdc06d11a80"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:55:09.415747 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-a22fec61-6e2a-40ee-9611-e5e046ecf339 req-5910ef62-3049-407a-889a-54e984a8edc8 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:09.416291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-a22fec61-6e2a-40ee-9611-e5e046ecf339 req-5910ef62-3049-407a-889a-54e984a8edc8 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:09.416726 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-a22fec61-6e2a-40ee-9611-e5e046ecf339 req-5910ef62-3049-407a-889a-54e984a8edc8 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:09.427971 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-a22fec61-6e2a-40ee-9611-e5e046ecf339 req-5910ef62-3049-407a-889a-54e984a8edc8 service nova] Creating event network-changed:8a1c5189-8d93-4813-95d3-4fdc06d11a80 for instance a3538515-fbfd-4f28-bc94-dd5e63e10656 on hv-cinder-86149 Oct 30 00:55:09.434575 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-a22fec61-6e2a-40ee-9611-e5e046ecf339 req-5910ef62-3049-407a-889a-54e984a8edc8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033776 Oct 30 00:55:09.435435 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 350/716] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:55:11.449738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-9e3d8271-059e-4d92-9de6-5e6f3bf420d5 req-17cce468-6b71-44f9-aea7-4e198f2d83bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3538515-fbfd-4f28-bc94-dd5e63e10656", "tag": "8a1c5189-8d93-4813-95d3-4fdc06d11a80"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:55:11.460331 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-9e3d8271-059e-4d92-9de6-5e6f3bf420d5 req-17cce468-6b71-44f9-aea7-4e198f2d83bc service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:11.460791 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-9e3d8271-059e-4d92-9de6-5e6f3bf420d5 req-17cce468-6b71-44f9-aea7-4e198f2d83bc service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:11.461213 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-9e3d8271-059e-4d92-9de6-5e6f3bf420d5 req-17cce468-6b71-44f9-aea7-4e198f2d83bc service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:11.472407 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-9e3d8271-059e-4d92-9de6-5e6f3bf420d5 req-17cce468-6b71-44f9-aea7-4e198f2d83bc service nova] Creating event network-changed:8a1c5189-8d93-4813-95d3-4fdc06d11a80 for instance a3538515-fbfd-4f28-bc94-dd5e63e10656 on hv-cinder-86149 Oct 30 00:55:11.477542 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-9e3d8271-059e-4d92-9de6-5e6f3bf420d5 req-17cce468-6b71-44f9-aea7-4e198f2d83bc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031937 Oct 30 00:55:11.478096 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 367/717] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:55:13.843615 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-390be4a1-cd22-433e-a9dc-f159bd15052e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:13.844219 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-390be4a1-cd22-433e-a9dc-f159bd15052e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:13.850396 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-390be4a1-cd22-433e-a9dc-f159bd15052e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:13.850878 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-390be4a1-cd22-433e-a9dc-f159bd15052e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:13.851308 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-390be4a1-cd22-433e-a9dc-f159bd15052e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:13.852006 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-390be4a1-cd22-433e-a9dc-f159bd15052e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:13.852504 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-390be4a1-cd22-433e-a9dc-f159bd15052e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:13.852925 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-390be4a1-cd22-433e-a9dc-f159bd15052e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:13.983109 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.objects.instance [None req-390be4a1-cd22-433e-a9dc-f159bd15052e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lazy-loading 'services' on Instance uuid 4250f845-2f85-48d9-bf11-5b7093520b26 {{(pid=125553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:55:14.098596 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-390be4a1-cd22-433e-a9dc-f159bd15052e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26/os-volume_attachments/10252a4f-a238-4788-9413-0a83986893c4" status: 202 len: 0 microversion: 2.1 time: 0.260159 Oct 30 00:55:14.099111 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 351/718] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Oct 30 00:55:13 2022] DELETE /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26/os-volume_attachments/10252a4f-a238-4788-9413-0a83986893c4 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 00:55:15.223975 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d338f9bc-26a2-451d-a6c1-8f9fde02d005 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:55:15.230183 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d338f9bc-26a2-451d-a6c1-8f9fde02d005 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:15.230657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d338f9bc-26a2-451d-a6c1-8f9fde02d005 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:15.231086 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d338f9bc-26a2-451d-a6c1-8f9fde02d005 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:15.293451 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-d338f9bc-26a2-451d-a6c1-8f9fde02d005 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Going to try to stop instance {{(pid=125554) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 30 00:55:15.337263 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-d338f9bc-26a2-451d-a6c1-8f9fde02d005 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "POST /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26/action" status: 202 len: 0 microversion: 2.1 time: 0.117826 Oct 30 00:55:15.337903 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 368/719] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Oct 30 00:55:15 2022] POST /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 00:55:15.347607 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-8238644a-74f0-4f15-a61d-d728629261ba tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:15.348342 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-8238644a-74f0-4f15-a61d-d728629261ba tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:15.354959 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8238644a-74f0-4f15-a61d-d728629261ba tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:15.355444 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8238644a-74f0-4f15-a61d-d728629261ba tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:15.355882 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8238644a-74f0-4f15-a61d-d728629261ba tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:15.356660 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8238644a-74f0-4f15-a61d-d728629261ba tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:15.358227 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8238644a-74f0-4f15-a61d-d728629261ba tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:15.358447 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8238644a-74f0-4f15-a61d-d728629261ba tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:15.377354 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:15.495556 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8238644a-74f0-4f15-a61d-d728629261ba tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:15.504202 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-8238644a-74f0-4f15-a61d-d728629261ba tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1677 microversion: 2.1 time: 0.161369 Oct 30 00:55:15.504764 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 352/720] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:55:15 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:55:16.528135 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-6496334f-6c5f-469e-9645-594fc875e2d5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:16.528870 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-6496334f-6c5f-469e-9645-594fc875e2d5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:16.534922 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6496334f-6c5f-469e-9645-594fc875e2d5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:16.535394 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6496334f-6c5f-469e-9645-594fc875e2d5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:16.535821 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6496334f-6c5f-469e-9645-594fc875e2d5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:16.536546 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6496334f-6c5f-469e-9645-594fc875e2d5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:16.537001 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6496334f-6c5f-469e-9645-594fc875e2d5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:16.537406 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6496334f-6c5f-469e-9645-594fc875e2d5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:16.664105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6496334f-6c5f-469e-9645-594fc875e2d5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:16.671897 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-6496334f-6c5f-469e-9645-594fc875e2d5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1677 microversion: 2.1 time: 0.148400 Oct 30 00:55:16.672501 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 369/721] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:55:16 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:55:16.745013 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-8d0a10b0-0e1a-4b1a-86c2-0a011f00830f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:16.745548 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-8d0a10b0-0e1a-4b1a-86c2-0a011f00830f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:16.752934 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8d0a10b0-0e1a-4b1a-86c2-0a011f00830f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:16.753413 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8d0a10b0-0e1a-4b1a-86c2-0a011f00830f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:16.753850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8d0a10b0-0e1a-4b1a-86c2-0a011f00830f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:16.754539 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8d0a10b0-0e1a-4b1a-86c2-0a011f00830f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:16.754987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8d0a10b0-0e1a-4b1a-86c2-0a011f00830f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:16.755407 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8d0a10b0-0e1a-4b1a-86c2-0a011f00830f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:16.783713 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-8d0a10b0-0e1a-4b1a-86c2-0a011f00830f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833/os-volume_attachments/5f0e847c-44e2-4689-8000-222c1111e4b9" status: 200 len: 194 microversion: 2.20 time: 0.042679 Oct 30 00:55:16.784246 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 353/722] 10.222.0.36 () {60 vars in 1454 bytes} [Sun Oct 30 00:55:16 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833/os-volume_attachments/5f0e847c-44e2-4689-8000-222c1111e4b9 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:55:16.852057 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-5a67a051-3ad1-4d80-b10b-091747341c75 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:16.852571 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-5a67a051-3ad1-4d80-b10b-091747341c75 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:16.858947 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5a67a051-3ad1-4d80-b10b-091747341c75 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:16.859415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5a67a051-3ad1-4d80-b10b-091747341c75 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:16.859840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5a67a051-3ad1-4d80-b10b-091747341c75 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:16.860540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5a67a051-3ad1-4d80-b10b-091747341c75 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:16.860986 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5a67a051-3ad1-4d80-b10b-091747341c75 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:16.861401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5a67a051-3ad1-4d80-b10b-091747341c75 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:16.941381 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.objects.instance [None req-5a67a051-3ad1-4d80-b10b-091747341c75 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lazy-loading 'services' on Instance uuid 00747eb3-1c2b-40b2-8e0a-9c440529e833 {{(pid=125554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:55:17.015054 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-5a67a051-3ad1-4d80-b10b-091747341c75 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833/os-volume_attachments/5f0e847c-44e2-4689-8000-222c1111e4b9" status: 202 len: 0 microversion: 2.20 time: 0.166763 Oct 30 00:55:17.015634 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 370/723] 10.222.0.36 () {60 vars in 1457 bytes} [Sun Oct 30 00:55:16 2022] DELETE /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833/os-volume_attachments/5f0e847c-44e2-4689-8000-222c1111e4b9 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 00:55:17.024130 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-df5b4a3a-2fc0-4dee-aaee-953c14bc4e45 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:17.026445 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-df5b4a3a-2fc0-4dee-aaee-953c14bc4e45 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:17.033314 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-df5b4a3a-2fc0-4dee-aaee-953c14bc4e45 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:17.033978 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-df5b4a3a-2fc0-4dee-aaee-953c14bc4e45 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:17.034345 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-df5b4a3a-2fc0-4dee-aaee-953c14bc4e45 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:17.035115 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-df5b4a3a-2fc0-4dee-aaee-953c14bc4e45 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:17.035577 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-df5b4a3a-2fc0-4dee-aaee-953c14bc4e45 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:17.036023 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-df5b4a3a-2fc0-4dee-aaee-953c14bc4e45 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:17.066622 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-df5b4a3a-2fc0-4dee-aaee-953c14bc4e45 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046457 Oct 30 00:55:17.067177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 354/724] 10.222.0.36 () {60 vars in 1343 bytes} [Sun Oct 30 00:55:17 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:55:17.695894 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-429497c0-a362-489c-802a-1efe6dd97f95 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:17.696607 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-429497c0-a362-489c-802a-1efe6dd97f95 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:17.704104 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-429497c0-a362-489c-802a-1efe6dd97f95 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:17.704585 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-429497c0-a362-489c-802a-1efe6dd97f95 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:17.705013 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-429497c0-a362-489c-802a-1efe6dd97f95 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:17.705691 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-429497c0-a362-489c-802a-1efe6dd97f95 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:17.706134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-429497c0-a362-489c-802a-1efe6dd97f95 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:17.706549 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-429497c0-a362-489c-802a-1efe6dd97f95 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:17.837619 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-429497c0-a362-489c-802a-1efe6dd97f95 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:17.846390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-429497c0-a362-489c-802a-1efe6dd97f95 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1677 microversion: 2.1 time: 0.154648 Oct 30 00:55:17.846938 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 371/725] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:55:17 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:55:18.079836 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5b80d1cd-2361-4766-a6fe-b218a892ba20 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:18.081990 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5b80d1cd-2361-4766-a6fe-b218a892ba20 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:18.088342 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5b80d1cd-2361-4766-a6fe-b218a892ba20 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:18.088828 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5b80d1cd-2361-4766-a6fe-b218a892ba20 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:18.089325 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5b80d1cd-2361-4766-a6fe-b218a892ba20 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:18.090093 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5b80d1cd-2361-4766-a6fe-b218a892ba20 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:18.090578 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5b80d1cd-2361-4766-a6fe-b218a892ba20 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:18.090960 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5b80d1cd-2361-4766-a6fe-b218a892ba20 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:18.124346 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5b80d1cd-2361-4766-a6fe-b218a892ba20 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049282 Oct 30 00:55:18.125142 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 355/726] 10.222.0.36 () {60 vars in 1343 bytes} [Sun Oct 30 00:55:18 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:55:18.869742 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-6897a4d5-4148-4149-84df-c99026a6b269 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:18.870350 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-6897a4d5-4148-4149-84df-c99026a6b269 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:18.876928 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6897a4d5-4148-4149-84df-c99026a6b269 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:18.877418 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6897a4d5-4148-4149-84df-c99026a6b269 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:18.877852 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6897a4d5-4148-4149-84df-c99026a6b269 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:18.878551 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6897a4d5-4148-4149-84df-c99026a6b269 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:18.878999 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6897a4d5-4148-4149-84df-c99026a6b269 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:18.879419 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6897a4d5-4148-4149-84df-c99026a6b269 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:19.007290 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6897a4d5-4148-4149-84df-c99026a6b269 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:19.015568 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-6897a4d5-4148-4149-84df-c99026a6b269 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1677 microversion: 2.1 time: 0.149716 Oct 30 00:55:19.016141 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 372/727] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:55:18 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:55:19.137293 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-4ae1206d-9ec1-4016-b046-34674b04dccb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:19.140072 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-4ae1206d-9ec1-4016-b046-34674b04dccb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:19.142381 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=35 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:19.147685 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4ae1206d-9ec1-4016-b046-34674b04dccb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:19.148199 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4ae1206d-9ec1-4016-b046-34674b04dccb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:19.148634 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4ae1206d-9ec1-4016-b046-34674b04dccb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:19.149331 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4ae1206d-9ec1-4016-b046-34674b04dccb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:19.149776 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4ae1206d-9ec1-4016-b046-34674b04dccb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:19.150193 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4ae1206d-9ec1-4016-b046-34674b04dccb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:19.178998 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-4ae1206d-9ec1-4016-b046-34674b04dccb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045659 Oct 30 00:55:19.179532 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 356/728] 10.222.0.36 () {60 vars in 1343 bytes} [Sun Oct 30 00:55:19 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:55:19.243081 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-801df44e-d7ac-4422-857f-56dcb31683f5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:19.243608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-801df44e-d7ac-4422-857f-56dcb31683f5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:19.250876 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-801df44e-d7ac-4422-857f-56dcb31683f5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:19.251353 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-801df44e-d7ac-4422-857f-56dcb31683f5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:19.251787 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-801df44e-d7ac-4422-857f-56dcb31683f5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:19.252499 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-801df44e-d7ac-4422-857f-56dcb31683f5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:19.252943 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-801df44e-d7ac-4422-857f-56dcb31683f5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:19.253356 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-801df44e-d7ac-4422-857f-56dcb31683f5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:19.286937 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-801df44e-d7ac-4422-857f-56dcb31683f5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Going to try to terminate instance {{(pid=125554) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 00:55:19.366028 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-801df44e-d7ac-4422-857f-56dcb31683f5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 204 len: 0 microversion: 2.20 time: 0.126451 Oct 30 00:55:19.366660 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 373/729] 10.222.0.36 () {60 vars in 1280 bytes} [Sun Oct 30 00:55:19 2022] DELETE /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 00:55:19.375722 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-4747a36e-93af-4f49-a17c-916b1230b66f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:19.376494 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-4747a36e-93af-4f49-a17c-916b1230b66f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:19.382301 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4747a36e-93af-4f49-a17c-916b1230b66f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:19.382782 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4747a36e-93af-4f49-a17c-916b1230b66f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:19.383216 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4747a36e-93af-4f49-a17c-916b1230b66f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:19.383907 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4747a36e-93af-4f49-a17c-916b1230b66f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:19.384416 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4747a36e-93af-4f49-a17c-916b1230b66f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:19.384853 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4747a36e-93af-4f49-a17c-916b1230b66f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:19.514222 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-4747a36e-93af-4f49-a17c-916b1230b66f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:19.522231 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-4747a36e-93af-4f49-a17c-916b1230b66f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:19.523670 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-4747a36e-93af-4f49-a17c-916b1230b66f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:19.524863 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-4747a36e-93af-4f49-a17c-916b1230b66f tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.153681 Oct 30 00:55:19.525420 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 357/730] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:55:19 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:55:20.039961 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d04fa532-ad6c-4f3a-ba16-12627be4affe tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:20.040677 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-d04fa532-ad6c-4f3a-ba16-12627be4affe tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:20.047669 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d04fa532-ad6c-4f3a-ba16-12627be4affe tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:20.048246 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d04fa532-ad6c-4f3a-ba16-12627be4affe tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:20.048680 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d04fa532-ad6c-4f3a-ba16-12627be4affe tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:20.049378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d04fa532-ad6c-4f3a-ba16-12627be4affe tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:20.049810 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d04fa532-ad6c-4f3a-ba16-12627be4affe tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:20.050231 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d04fa532-ad6c-4f3a-ba16-12627be4affe tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:20.180589 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-d04fa532-ad6c-4f3a-ba16-12627be4affe tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:20.189392 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-d04fa532-ad6c-4f3a-ba16-12627be4affe tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1677 microversion: 2.1 time: 0.153591 Oct 30 00:55:20.189961 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 374/731] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:55:20 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:55:20.552110 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-4f40c8a7-f58a-44f9-b306-0b88842d9495 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:20.552697 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-4f40c8a7-f58a-44f9-b306-0b88842d9495 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:20.559161 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4f40c8a7-f58a-44f9-b306-0b88842d9495 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:20.559632 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4f40c8a7-f58a-44f9-b306-0b88842d9495 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:20.560058 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4f40c8a7-f58a-44f9-b306-0b88842d9495 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:20.561945 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4f40c8a7-f58a-44f9-b306-0b88842d9495 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:20.562395 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4f40c8a7-f58a-44f9-b306-0b88842d9495 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:20.562809 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4f40c8a7-f58a-44f9-b306-0b88842d9495 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:20.693885 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-4f40c8a7-f58a-44f9-b306-0b88842d9495 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:20.702274 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-4f40c8a7-f58a-44f9-b306-0b88842d9495 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:20.703699 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-4f40c8a7-f58a-44f9-b306-0b88842d9495 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:20.704877 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-4f40c8a7-f58a-44f9-b306-0b88842d9495 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.156634 Oct 30 00:55:20.705427 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 358/732] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:55:20 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:55:21.213906 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-8a0f20a0-9c6c-4abe-91b1-1a896a937176 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:21.214509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-8a0f20a0-9c6c-4abe-91b1-1a896a937176 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:21.221464 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8a0f20a0-9c6c-4abe-91b1-1a896a937176 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:21.221939 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8a0f20a0-9c6c-4abe-91b1-1a896a937176 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:21.222366 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8a0f20a0-9c6c-4abe-91b1-1a896a937176 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:21.223043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8a0f20a0-9c6c-4abe-91b1-1a896a937176 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:21.223486 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8a0f20a0-9c6c-4abe-91b1-1a896a937176 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:21.223901 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8a0f20a0-9c6c-4abe-91b1-1a896a937176 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:21.416886 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-8a0f20a0-9c6c-4abe-91b1-1a896a937176 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:21.426463 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-8a0f20a0-9c6c-4abe-91b1-1a896a937176 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1677 microversion: 2.1 time: 0.216272 Oct 30 00:55:21.427032 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 375/733] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:55:21 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:55:21.732041 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1206bc8b-7506-4820-9dcd-1db1131efc04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:21.733926 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1206bc8b-7506-4820-9dcd-1db1131efc04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:21.743881 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1206bc8b-7506-4820-9dcd-1db1131efc04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:21.744402 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1206bc8b-7506-4820-9dcd-1db1131efc04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:21.744836 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1206bc8b-7506-4820-9dcd-1db1131efc04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:21.745542 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1206bc8b-7506-4820-9dcd-1db1131efc04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:21.745992 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1206bc8b-7506-4820-9dcd-1db1131efc04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:21.746539 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1206bc8b-7506-4820-9dcd-1db1131efc04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:21.887089 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1206bc8b-7506-4820-9dcd-1db1131efc04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:21.896808 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1206bc8b-7506-4820-9dcd-1db1131efc04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:21.898208 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1206bc8b-7506-4820-9dcd-1db1131efc04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:21.899358 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1206bc8b-7506-4820-9dcd-1db1131efc04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1723 microversion: 2.20 time: 0.172610 Oct 30 00:55:21.899902 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 359/734] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:55:21 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:55:22.462383 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-91810c77-5f5f-45d6-8e95-d4376fee202d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:22.463248 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-91810c77-5f5f-45d6-8e95-d4376fee202d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:22.475604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-91810c77-5f5f-45d6-8e95-d4376fee202d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:22.476194 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-91810c77-5f5f-45d6-8e95-d4376fee202d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:22.476638 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-91810c77-5f5f-45d6-8e95-d4376fee202d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:22.477396 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-91810c77-5f5f-45d6-8e95-d4376fee202d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:22.478058 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-91810c77-5f5f-45d6-8e95-d4376fee202d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:22.478782 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-91810c77-5f5f-45d6-8e95-d4376fee202d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:22.636595 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-7d03dcc7-344c-4aed-b172-a0a4262eb60f req-ee658f9e-36a8-4abf-8da0-43c9f593c471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00747eb3-1c2b-40b2-8e0a-9c440529e833", "name": "network-vif-deleted", "tag": "0b7471a7-8df2-4f56-8dad-8f89610685f3"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:55:22.641444 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-91810c77-5f5f-45d6-8e95-d4376fee202d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:22.650529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-91810c77-5f5f-45d6-8e95-d4376fee202d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1677 microversion: 2.1 time: 0.204336 Oct 30 00:55:22.651591 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 376/735] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:55:22 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1677 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:55:22.657829 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-7d03dcc7-344c-4aed-b172-a0a4262eb60f req-ee658f9e-36a8-4abf-8da0-43c9f593c471 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:22.658436 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-7d03dcc7-344c-4aed-b172-a0a4262eb60f req-ee658f9e-36a8-4abf-8da0-43c9f593c471 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:22.659070 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-7d03dcc7-344c-4aed-b172-a0a4262eb60f req-ee658f9e-36a8-4abf-8da0-43c9f593c471 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:22.674237 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-7d03dcc7-344c-4aed-b172-a0a4262eb60f req-ee658f9e-36a8-4abf-8da0-43c9f593c471 service nova] Creating event network-vif-deleted:0b7471a7-8df2-4f56-8dad-8f89610685f3 for instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 on hv-cinder-86149 Oct 30 00:55:22.681084 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-7d03dcc7-344c-4aed-b172-a0a4262eb60f req-ee658f9e-36a8-4abf-8da0-43c9f593c471 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219367 Oct 30 00:55:22.681985 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 360/736] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:55:22.925827 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-188d2c70-26dc-4790-bd48-848c2ae2141a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:22.926554 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-188d2c70-26dc-4790-bd48-848c2ae2141a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:22.932655 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-188d2c70-26dc-4790-bd48-848c2ae2141a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:22.933131 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-188d2c70-26dc-4790-bd48-848c2ae2141a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:22.933560 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-188d2c70-26dc-4790-bd48-848c2ae2141a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:22.934256 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-188d2c70-26dc-4790-bd48-848c2ae2141a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:22.934750 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-188d2c70-26dc-4790-bd48-848c2ae2141a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:22.935197 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-188d2c70-26dc-4790-bd48-848c2ae2141a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:22.967608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-188d2c70-26dc-4790-bd48-848c2ae2141a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:22.968212 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-188d2c70-26dc-4790-bd48-848c2ae2141a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:22.968719 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-188d2c70-26dc-4790-bd48-848c2ae2141a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:22.969235 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.objects.instance [None req-188d2c70-26dc-4790-bd48-848c2ae2141a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lazy-loading 'fault' on Instance uuid 00747eb3-1c2b-40b2-8e0a-9c440529e833 {{(pid=125554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:55:23.017492 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-188d2c70-26dc-4790-bd48-848c2ae2141a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:23.025405 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-188d2c70-26dc-4790-bd48-848c2ae2141a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:23.026834 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-188d2c70-26dc-4790-bd48-848c2ae2141a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:23.027980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-188d2c70-26dc-4790-bd48-848c2ae2141a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 200 len: 1372 microversion: 2.20 time: 0.106392 Oct 30 00:55:23.028572 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 377/737] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:55:22 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:55:23.677435 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-eebb074e-d71e-431f-9808-0f28a7d2ec27 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:23.678128 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-eebb074e-d71e-431f-9808-0f28a7d2ec27 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:23.684278 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-eebb074e-d71e-431f-9808-0f28a7d2ec27 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:23.684754 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-eebb074e-d71e-431f-9808-0f28a7d2ec27 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:23.685184 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-eebb074e-d71e-431f-9808-0f28a7d2ec27 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:23.685965 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-eebb074e-d71e-431f-9808-0f28a7d2ec27 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:23.686414 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-eebb074e-d71e-431f-9808-0f28a7d2ec27 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:23.686831 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-eebb074e-d71e-431f-9808-0f28a7d2ec27 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:23.816647 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-eebb074e-d71e-431f-9808-0f28a7d2ec27 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:23.824416 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-eebb074e-d71e-431f-9808-0f28a7d2ec27 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1677 microversion: 2.1 time: 0.151645 Oct 30 00:55:23.824972 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 361/738] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:55:23 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:55:24.056027 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-5dd71250-fbec-43be-ac4b-a1fc88e8e76a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:24.056662 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-5dd71250-fbec-43be-ac4b-a1fc88e8e76a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:24.063493 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5dd71250-fbec-43be-ac4b-a1fc88e8e76a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:24.064069 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5dd71250-fbec-43be-ac4b-a1fc88e8e76a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:24.064558 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5dd71250-fbec-43be-ac4b-a1fc88e8e76a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:24.065253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5dd71250-fbec-43be-ac4b-a1fc88e8e76a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:24.065711 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5dd71250-fbec-43be-ac4b-a1fc88e8e76a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:24.066177 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5dd71250-fbec-43be-ac4b-a1fc88e8e76a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:24.080491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-5dd71250-fbec-43be-ac4b-a1fc88e8e76a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] HTTP exception thrown: Instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 could not be found. Oct 30 00:55:24.082134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-5dd71250-fbec-43be-ac4b-a1fc88e8e76a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Request method failure captured: Oct 30 00:55:24.082134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 HTTP/1.1 Oct 30 00:55:24.082134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 00:55:24.082134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 00:55:24.082134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 00:55:24.082134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 00:55:24.082134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 00:55:24.082134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 00:55:24.082134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 00:55:24.082134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 00:55:24.082134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcnPoHIxSE33JzVLE1p0UnANGXki84SKooQwYN6Zvvs7aW6C3LrS3JMJsnEts_GAjUa8Wv9wtzvQkJaP43dRYygck_ynDNpbXhjRjWoDek5RsBi3WZSRrrC6hGNyFjx2l_482fUj5ys0_JHdNfGIu5PI6zdsZzyRIlUkMliHrKgorvg Oct 30 00:55:24.082134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 00:55:24.082134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 00:55:24.082134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 00:55:24.082134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 00:55:24.082134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Openstack-Nova-Api-Version: 2.20 Oct 30 00:55:24.082134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 00:55:24.082134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 00:55:24.082134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: 0f3b2aeb0e094f539e4affd66ea66272 Oct 30 00:55:24.082134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-660388917 Oct 30 00:55:24.082134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 00:55:24.082134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 00:55:24.083889 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:55:24.083889 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-AttachVolumeShelveTestJSON-660388917 Oct 30 00:55:24.083889 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: 0f3b2aeb0e094f539e4affd66ea66272 Oct 30 00:55:24.083889 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-660388917 Oct 30 00:55:24.083889 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-AttachVolumeShelveTestJSON-660388917-project Oct 30 00:55:24.083889 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 00:55:24.083889 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 00:55:24.083889 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: df1ee15eb3bc468188a9d8c1af46529c Oct 30 00:55:24.083889 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-AttachVolumeShelveTestJSON-660388917-project Oct 30 00:55:24.083889 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 00:55:24.083889 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 could not be found. Oct 30 00:55:24.083889 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': '00747eb3-1c2b-40b2-8e0a-9c440529e833'} Oct 30 00:55:24.088148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:55:24.088148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:55:24.088148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:55:24.088148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:55:24.088148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:55:24.088148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:55:24.088148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:55:24.088148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:55:24.088148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:55:24.088148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:55:24.088148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 could not be found. Oct 30 00:55:24.088148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:55:24.088148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:55:24.088148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:55:24.088148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:55:24.088148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:55:24.088148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:55:24.088148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:55:24.088148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:55:24.088148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:55:24.089606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:55:24.089606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 00:55:24.089606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 00:55:24.089606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:55:24.089606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:55:24.089606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:55:24.089606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:55:24.089606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 could not be found. Oct 30 00:55:24.089606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:55:24.089606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:55:24.089606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:55:24.089606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:55:24.089606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:55:24.089606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:55:24.089606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:55:24.089606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:55:24.089606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 could not be found. Oct 30 00:55:24.089606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:55:24.090901 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-5dd71250-fbec-43be-ac4b-a1fc88e8e76a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Returning 404 to user: Instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:55:24.090901 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-5dd71250-fbec-43be-ac4b-a1fc88e8e76a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 404 len: 111 microversion: 2.20 time: 0.031414 Oct 30 00:55:24.090901 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 378/739] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:55:24 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 00:55:24.095379 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-ef8cb451-4e83-4707-8b36-5fda056d496d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '.version_select at 0x7faf75b975e0>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:24.134417 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-ef8cb451-4e83-4707-8b36-5fda056d496d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2004726731" status: 204 len: 0 microversion: 2.20 time: 0.044362 Oct 30 00:55:24.135027 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 362/740] 10.222.0.36 () {60 vars in 1262 bytes} [Sun Oct 30 00:55:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2004726731 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 00:55:24.807724 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-302681e3-bcc6-4d3b-80f0-9c56d31d38c2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Action: 'create', calling method: .version_select at 0x7faf757c89d0>, body: {"keypair": {"name": "tempest-keypair-1042805863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9J8wcQrBnub+5GcvF6IUdJhRaV7UzwTFKkeq20dCcln0BV/T9KDBgnOYgJkyMO5WwGrT+Bf8yjWJ20Yl4OEUCwLGYuJDvXpEqeII2S2dTpHr4nJM3F09hnzbubWFpMUA=="}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:55:24.823563 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-302681e3-bcc6-4d3b-80f0-9c56d31d38c2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Getting quotas for project 0f3b2aeb0e094f539e4affd66ea66272. Resources: {'key_pairs'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 00:55:24.828354 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-302681e3-bcc6-4d3b-80f0-9c56d31d38c2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Getting quotas for user df1ee15eb3bc468188a9d8c1af46529c and project 0f3b2aeb0e094f539e4affd66ea66272. Resources: {'key_pairs'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 00:55:24.849771 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-bbb70b46-05a3-490e-a7a1-3f5ef7cd177c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:24.850657 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-bbb70b46-05a3-490e-a7a1-3f5ef7cd177c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:24.852756 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-302681e3-bcc6-4d3b-80f0-9c56d31d38c2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048845 Oct 30 00:55:24.853485 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 379/741] 10.222.0.36 () {62 vars in 1200 bytes} [Sun Oct 30 00:55:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 30 00:55:24.859764 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bbb70b46-05a3-490e-a7a1-3f5ef7cd177c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:24.865474 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bbb70b46-05a3-490e-a7a1-3f5ef7cd177c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:24.865967 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bbb70b46-05a3-490e-a7a1-3f5ef7cd177c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:24.866732 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bbb70b46-05a3-490e-a7a1-3f5ef7cd177c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:24.867184 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bbb70b46-05a3-490e-a7a1-3f5ef7cd177c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:24.867618 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bbb70b46-05a3-490e-a7a1-3f5ef7cd177c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:25.073166 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-bbb70b46-05a3-490e-a7a1-3f5ef7cd177c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:25.094024 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-bbb70b46-05a3-490e-a7a1-3f5ef7cd177c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1677 microversion: 2.1 time: 0.249405 Oct 30 00:55:25.095062 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 363/742] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:55:24 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1677 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:55:26.128804 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-1391c50f-64ab-46b7-a1f6-9105a1ba82db tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:26.129539 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-1391c50f-64ab-46b7-a1f6-9105a1ba82db tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:26.136235 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1391c50f-64ab-46b7-a1f6-9105a1ba82db tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:26.136723 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1391c50f-64ab-46b7-a1f6-9105a1ba82db tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:26.137159 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1391c50f-64ab-46b7-a1f6-9105a1ba82db tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:26.137856 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1391c50f-64ab-46b7-a1f6-9105a1ba82db tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:26.138303 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1391c50f-64ab-46b7-a1f6-9105a1ba82db tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:26.139466 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1391c50f-64ab-46b7-a1f6-9105a1ba82db tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:26.263240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-24a58c32-20a4-4e67-9f77-987487e8d9cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-202344228", "imageRef": "27983dee-4bd6-4aad-9c28-22bd5382709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "adf2f392-f264-4582-889e-f327b7a40c30"}], "security_groups": [{"name": "tempest-securitygroup--57223048"}], "key_name": "tempest-keypair-1042805863", "user_data": "}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:55:26.275086 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-1391c50f-64ab-46b7-a1f6-9105a1ba82db tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:26.282952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-1391c50f-64ab-46b7-a1f6-9105a1ba82db tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1654 microversion: 2.1 time: 0.158599 Oct 30 00:55:26.283514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 380/743] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:55:26 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1654 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:55:26.305211 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ee858a51-bd8e-4c6c-820a-e54cb8c78165 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:55:26.312210 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ee858a51-bd8e-4c6c-820a-e54cb8c78165 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:26.312797 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ee858a51-bd8e-4c6c-820a-e54cb8c78165 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:26.313299 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ee858a51-bd8e-4c6c-820a-e54cb8c78165 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:26.336498 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ee858a51-bd8e-4c6c-820a-e54cb8c78165 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Going to try to start instance {{(pid=125554) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 30 00:55:26.340838 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:26.371142 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.network.neutron [None req-24a58c32-20a4-4e67-9f77-987487e8d9cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] validate_networks() for [('adf2f392-f264-4582-889e-f327b7a40c30', None, None, None, None, None)] {{(pid=125553) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 00:55:26.382786 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ee858a51-bd8e-4c6c-820a-e54cb8c78165 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "POST /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26/action" status: 202 len: 0 microversion: 2.1 time: 0.080797 Oct 30 00:55:26.383461 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 381/744] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Oct 30 00:55:26 2022] POST /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 00:55:26.393066 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-02c12dc7-121e-4b4d-8879-8ddcd80b5e93 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:26.393892 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-02c12dc7-121e-4b4d-8879-8ddcd80b5e93 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:26.400436 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-02c12dc7-121e-4b4d-8879-8ddcd80b5e93 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:26.400958 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-02c12dc7-121e-4b4d-8879-8ddcd80b5e93 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:26.401375 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-02c12dc7-121e-4b4d-8879-8ddcd80b5e93 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:26.402221 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-02c12dc7-121e-4b4d-8879-8ddcd80b5e93 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:26.402676 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-02c12dc7-121e-4b4d-8879-8ddcd80b5e93 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:26.403096 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-02c12dc7-121e-4b4d-8879-8ddcd80b5e93 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:26.582808 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-02c12dc7-121e-4b4d-8879-8ddcd80b5e93 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:26.591282 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-02c12dc7-121e-4b4d-8879-8ddcd80b5e93 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1663 microversion: 2.1 time: 0.202263 Oct 30 00:55:26.595023 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 382/745] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:55:26 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1663 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:55:27.149964 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-24a58c32-20a4-4e67-9f77-987487e8d9cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Flavor limits 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 00:55:27.150389 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-24a58c32-20a4-4e67-9f77-987487e8d9cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Image limits 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 00:55:27.150899 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-24a58c32-20a4-4e67-9f77-987487e8d9cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Flavor pref 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 00:55:27.151305 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-24a58c32-20a4-4e67-9f77-987487e8d9cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Image pref 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 00:55:27.151716 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-24a58c32-20a4-4e67-9f77-987487e8d9cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 00:55:27.160898 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-24a58c32-20a4-4e67-9f77-987487e8d9cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:27.161374 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-24a58c32-20a4-4e67-9f77-987487e8d9cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:27.161803 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-24a58c32-20a4-4e67-9f77-987487e8d9cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:27.162526 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-24a58c32-20a4-4e67-9f77-987487e8d9cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:27.162973 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-24a58c32-20a4-4e67-9f77-987487e8d9cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:27.163392 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-24a58c32-20a4-4e67-9f77-987487e8d9cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:27.179434 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-24a58c32-20a4-4e67-9f77-987487e8d9cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Getting quotas for project 0f3b2aeb0e094f539e4affd66ea66272. Resources: {'instances', 'cores', 'ram'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 00:55:27.183922 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-24a58c32-20a4-4e67-9f77-987487e8d9cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Getting quotas for user df1ee15eb3bc468188a9d8c1af46529c and project 0f3b2aeb0e094f539e4affd66ea66272. Resources: {'instances', 'cores', 'ram'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 00:55:27.195465 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-24a58c32-20a4-4e67-9f77-987487e8d9cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Going to run 1 instances... {{(pid=125553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 00:55:27.197755 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-24a58c32-20a4-4e67-9f77-987487e8d9cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27983dee-4bd6-4aad-9c28-22bd5382709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 00:55:27.244523 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-24a58c32-20a4-4e67-9f77-987487e8d9cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.985589 Oct 30 00:55:27.245161 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 364/746] 10.222.0.36 () {62 vars in 1188 bytes} [Sun Oct 30 00:55:26 2022] POST /compute/v2.1/servers => generated 400 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 30 00:55:27.257941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2feb97d2-4347-4ac1-badc-3d1df146ef23 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:27.258546 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2feb97d2-4347-4ac1-badc-3d1df146ef23 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:27.313215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2feb97d2-4347-4ac1-badc-3d1df146ef23 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:27.321518 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2feb97d2-4347-4ac1-badc-3d1df146ef23 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:27.323107 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2feb97d2-4347-4ac1-badc-3d1df146ef23 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:27.324349 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2feb97d2-4347-4ac1-badc-3d1df146ef23 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1281 microversion: 2.20 time: 0.070543 Oct 30 00:55:27.325008 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 383/747] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:55:27 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:55:27.619160 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-2830dbb8-37f4-473e-b30f-75b50c897db2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:27.620595 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-2830dbb8-37f4-473e-b30f-75b50c897db2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:27.628757 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2830dbb8-37f4-473e-b30f-75b50c897db2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:27.629497 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2830dbb8-37f4-473e-b30f-75b50c897db2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:27.630213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2830dbb8-37f4-473e-b30f-75b50c897db2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:27.631251 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2830dbb8-37f4-473e-b30f-75b50c897db2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:27.631961 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2830dbb8-37f4-473e-b30f-75b50c897db2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:27.632748 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2830dbb8-37f4-473e-b30f-75b50c897db2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:27.765284 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-2830dbb8-37f4-473e-b30f-75b50c897db2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:27.773377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-2830dbb8-37f4-473e-b30f-75b50c897db2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1663 microversion: 2.1 time: 0.159950 Oct 30 00:55:27.773990 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 365/748] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:55:27 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:55:28.350135 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-793c2315-fa1e-443e-bb5f-cbd217c03362 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:28.351335 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-793c2315-fa1e-443e-bb5f-cbd217c03362 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:28.359833 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-793c2315-fa1e-443e-bb5f-cbd217c03362 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:28.360353 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-793c2315-fa1e-443e-bb5f-cbd217c03362 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:28.360859 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-793c2315-fa1e-443e-bb5f-cbd217c03362 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:28.361484 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-793c2315-fa1e-443e-bb5f-cbd217c03362 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:28.361933 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-793c2315-fa1e-443e-bb5f-cbd217c03362 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:28.362360 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-793c2315-fa1e-443e-bb5f-cbd217c03362 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:28.428263 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-793c2315-fa1e-443e-bb5f-cbd217c03362 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:28.437063 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-793c2315-fa1e-443e-bb5f-cbd217c03362 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:28.438529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-793c2315-fa1e-443e-bb5f-cbd217c03362 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:28.439624 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-793c2315-fa1e-443e-bb5f-cbd217c03362 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1333 microversion: 2.20 time: 0.093514 Oct 30 00:55:28.440186 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 384/749] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:55:28 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1333 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:55:28.797620 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-07fb986a-d08e-4db5-8c92-a6c87175d6d6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:28.798220 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-07fb986a-d08e-4db5-8c92-a6c87175d6d6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:28.804732 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-07fb986a-d08e-4db5-8c92-a6c87175d6d6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:28.805206 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-07fb986a-d08e-4db5-8c92-a6c87175d6d6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:28.805629 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-07fb986a-d08e-4db5-8c92-a6c87175d6d6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:28.806319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-07fb986a-d08e-4db5-8c92-a6c87175d6d6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:28.806759 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-07fb986a-d08e-4db5-8c92-a6c87175d6d6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:28.807172 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-07fb986a-d08e-4db5-8c92-a6c87175d6d6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:28.953588 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-07fb986a-d08e-4db5-8c92-a6c87175d6d6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:28.962871 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-07fb986a-d08e-4db5-8c92-a6c87175d6d6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1667 microversion: 2.1 time: 0.169497 Oct 30 00:55:28.963786 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 366/750] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:55:28 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1667 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:55:29.465882 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-fa56aaad-f88b-4010-9412-15aacec7cbe7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:29.466488 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-fa56aaad-f88b-4010-9412-15aacec7cbe7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:29.473133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fa56aaad-f88b-4010-9412-15aacec7cbe7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:29.473732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fa56aaad-f88b-4010-9412-15aacec7cbe7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:29.474346 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fa56aaad-f88b-4010-9412-15aacec7cbe7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:29.475130 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fa56aaad-f88b-4010-9412-15aacec7cbe7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:29.475579 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fa56aaad-f88b-4010-9412-15aacec7cbe7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:29.476001 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fa56aaad-f88b-4010-9412-15aacec7cbe7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:29.625944 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-fa56aaad-f88b-4010-9412-15aacec7cbe7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:29.634738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-fa56aaad-f88b-4010-9412-15aacec7cbe7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:29.636192 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-fa56aaad-f88b-4010-9412-15aacec7cbe7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:29.637504 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-fa56aaad-f88b-4010-9412-15aacec7cbe7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1405 microversion: 2.20 time: 0.176029 Oct 30 00:55:29.639204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 385/751] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:55:29 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:55:30.456758 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-b9f99bd3-cd23-4852-b7a5-d425b8a70ff6 req-dce8f413-fcce-4e1f-b6de-457b9df7de9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f745c72f-1429-408f-bbf6-9d254529e9b3", "tag": "d3536290-43b6-4818-9024-5c42427edf8f"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:55:30.468461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-b9f99bd3-cd23-4852-b7a5-d425b8a70ff6 req-dce8f413-fcce-4e1f-b6de-457b9df7de9d service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:30.469175 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-b9f99bd3-cd23-4852-b7a5-d425b8a70ff6 req-dce8f413-fcce-4e1f-b6de-457b9df7de9d service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:30.469675 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-b9f99bd3-cd23-4852-b7a5-d425b8a70ff6 req-dce8f413-fcce-4e1f-b6de-457b9df7de9d service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:30.481281 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-b9f99bd3-cd23-4852-b7a5-d425b8a70ff6 req-dce8f413-fcce-4e1f-b6de-457b9df7de9d service nova] Creating event network-changed:d3536290-43b6-4818-9024-5c42427edf8f for instance f745c72f-1429-408f-bbf6-9d254529e9b3 on hv-cinder-86149 Oct 30 00:55:30.486221 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-b9f99bd3-cd23-4852-b7a5-d425b8a70ff6 req-dce8f413-fcce-4e1f-b6de-457b9df7de9d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033654 Oct 30 00:55:30.486973 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 367/752] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:55:30.664575 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-392e6b98-6d79-4e7a-83ea-8c7f2438d406 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:30.665185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-392e6b98-6d79-4e7a-83ea-8c7f2438d406 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:30.671598 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-392e6b98-6d79-4e7a-83ea-8c7f2438d406 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:30.672092 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-392e6b98-6d79-4e7a-83ea-8c7f2438d406 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:30.672608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-392e6b98-6d79-4e7a-83ea-8c7f2438d406 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:30.673294 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-392e6b98-6d79-4e7a-83ea-8c7f2438d406 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:30.673742 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-392e6b98-6d79-4e7a-83ea-8c7f2438d406 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:30.674184 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-392e6b98-6d79-4e7a-83ea-8c7f2438d406 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:30.802921 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-392e6b98-6d79-4e7a-83ea-8c7f2438d406 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:30.811378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-392e6b98-6d79-4e7a-83ea-8c7f2438d406 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:30.812796 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-392e6b98-6d79-4e7a-83ea-8c7f2438d406 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:30.813898 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-392e6b98-6d79-4e7a-83ea-8c7f2438d406 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1405 microversion: 2.20 time: 0.153198 Oct 30 00:55:30.814457 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 386/753] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:55:30 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:55:31.841038 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-16ebe415-444c-4c2c-81ce-84d9b72b3c75 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:31.841736 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-16ebe415-444c-4c2c-81ce-84d9b72b3c75 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:31.847790 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-16ebe415-444c-4c2c-81ce-84d9b72b3c75 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:31.848293 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-16ebe415-444c-4c2c-81ce-84d9b72b3c75 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:31.848725 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-16ebe415-444c-4c2c-81ce-84d9b72b3c75 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:31.849408 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-16ebe415-444c-4c2c-81ce-84d9b72b3c75 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:31.849857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-16ebe415-444c-4c2c-81ce-84d9b72b3c75 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:31.850277 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-16ebe415-444c-4c2c-81ce-84d9b72b3c75 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:31.978267 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-16ebe415-444c-4c2c-81ce-84d9b72b3c75 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:31.986996 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-16ebe415-444c-4c2c-81ce-84d9b72b3c75 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:31.988459 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-16ebe415-444c-4c2c-81ce-84d9b72b3c75 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:31.989555 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-16ebe415-444c-4c2c-81ce-84d9b72b3c75 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1405 microversion: 2.20 time: 0.153330 Oct 30 00:55:31.990102 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 368/754] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:55:31 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:55:33.015494 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-9d49d4d6-96f6-4c69-b1d6-70c3e2bfc835 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:33.016130 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-9d49d4d6-96f6-4c69-b1d6-70c3e2bfc835 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:33.022682 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9d49d4d6-96f6-4c69-b1d6-70c3e2bfc835 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:33.023159 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9d49d4d6-96f6-4c69-b1d6-70c3e2bfc835 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:33.023592 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9d49d4d6-96f6-4c69-b1d6-70c3e2bfc835 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:33.024306 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9d49d4d6-96f6-4c69-b1d6-70c3e2bfc835 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:33.024763 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9d49d4d6-96f6-4c69-b1d6-70c3e2bfc835 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:33.025186 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9d49d4d6-96f6-4c69-b1d6-70c3e2bfc835 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:33.156502 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9d49d4d6-96f6-4c69-b1d6-70c3e2bfc835 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:33.164482 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9d49d4d6-96f6-4c69-b1d6-70c3e2bfc835 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:33.165904 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9d49d4d6-96f6-4c69-b1d6-70c3e2bfc835 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:33.167008 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-9d49d4d6-96f6-4c69-b1d6-70c3e2bfc835 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1405 microversion: 2.20 time: 0.156097 Oct 30 00:55:33.167561 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 387/755] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:55:33 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:55:34.191310 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-2c2858c5-91c8-4768-84d7-15768eb24651 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:34.191921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-2c2858c5-91c8-4768-84d7-15768eb24651 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:34.199487 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2c2858c5-91c8-4768-84d7-15768eb24651 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:34.199968 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2c2858c5-91c8-4768-84d7-15768eb24651 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:34.200427 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2c2858c5-91c8-4768-84d7-15768eb24651 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:34.201631 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2c2858c5-91c8-4768-84d7-15768eb24651 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:34.203070 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2c2858c5-91c8-4768-84d7-15768eb24651 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:34.203493 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2c2858c5-91c8-4768-84d7-15768eb24651 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:34.333177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-2c2858c5-91c8-4768-84d7-15768eb24651 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:34.341621 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-2c2858c5-91c8-4768-84d7-15768eb24651 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:34.343617 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-2c2858c5-91c8-4768-84d7-15768eb24651 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:34.344801 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-2c2858c5-91c8-4768-84d7-15768eb24651 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1405 microversion: 2.20 time: 0.157382 Oct 30 00:55:34.345341 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 369/756] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:55:34 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:55:35.370132 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-091f9a20-345d-4f3b-9f4d-39152609e02d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:35.370714 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-091f9a20-345d-4f3b-9f4d-39152609e02d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:35.377212 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-091f9a20-345d-4f3b-9f4d-39152609e02d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:35.377688 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-091f9a20-345d-4f3b-9f4d-39152609e02d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:35.378120 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-091f9a20-345d-4f3b-9f4d-39152609e02d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:35.378804 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-091f9a20-345d-4f3b-9f4d-39152609e02d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:35.379249 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-091f9a20-345d-4f3b-9f4d-39152609e02d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:35.379667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-091f9a20-345d-4f3b-9f4d-39152609e02d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:35.512370 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-091f9a20-345d-4f3b-9f4d-39152609e02d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:35.521049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-091f9a20-345d-4f3b-9f4d-39152609e02d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:35.522480 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-091f9a20-345d-4f3b-9f4d-39152609e02d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:35.523577 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-091f9a20-345d-4f3b-9f4d-39152609e02d tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1405 microversion: 2.20 time: 0.157372 Oct 30 00:55:35.524143 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 388/757] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:55:35 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:55:35.793451 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-5a05015b-8a70-44e1-bf49-7e37d646f719 req-7244b8a5-5c0f-4e18-818d-5cf116904ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f745c72f-1429-408f-bbf6-9d254529e9b3", "name": "network-vif-plugged", "status": "completed", "tag": "d3536290-43b6-4818-9024-5c42427edf8f"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:55:35.803169 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-5a05015b-8a70-44e1-bf49-7e37d646f719 req-7244b8a5-5c0f-4e18-818d-5cf116904ee2 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:35.803625 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-5a05015b-8a70-44e1-bf49-7e37d646f719 req-7244b8a5-5c0f-4e18-818d-5cf116904ee2 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:35.804040 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-5a05015b-8a70-44e1-bf49-7e37d646f719 req-7244b8a5-5c0f-4e18-818d-5cf116904ee2 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:35.814672 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-5a05015b-8a70-44e1-bf49-7e37d646f719 req-7244b8a5-5c0f-4e18-818d-5cf116904ee2 service nova] Creating event network-vif-plugged:d3536290-43b6-4818-9024-5c42427edf8f for instance f745c72f-1429-408f-bbf6-9d254529e9b3 on hv-cinder-86149 Oct 30 00:55:35.819713 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-5a05015b-8a70-44e1-bf49-7e37d646f719 req-7244b8a5-5c0f-4e18-818d-5cf116904ee2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086785 Oct 30 00:55:35.820729 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 370/758] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:55:36.550037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c8748421-5043-472b-804b-a41f22aa1dc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:36.550627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c8748421-5043-472b-804b-a41f22aa1dc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:36.556730 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c8748421-5043-472b-804b-a41f22aa1dc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:36.557207 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c8748421-5043-472b-804b-a41f22aa1dc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:36.557643 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c8748421-5043-472b-804b-a41f22aa1dc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:36.558321 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c8748421-5043-472b-804b-a41f22aa1dc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:36.558768 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c8748421-5043-472b-804b-a41f22aa1dc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:36.559183 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c8748421-5043-472b-804b-a41f22aa1dc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:36.685838 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c8748421-5043-472b-804b-a41f22aa1dc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:36.693770 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c8748421-5043-472b-804b-a41f22aa1dc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:36.695184 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c8748421-5043-472b-804b-a41f22aa1dc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:36.696297 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c8748421-5043-472b-804b-a41f22aa1dc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1405 microversion: 2.20 time: 0.151320 Oct 30 00:55:36.696856 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 389/759] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:55:36 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:55:37.723392 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d9efa1cd-d1bb-441d-9083-8584d00d7420 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:37.724076 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d9efa1cd-d1bb-441d-9083-8584d00d7420 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:37.726433 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=2 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:37.727096 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=6 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:37.734460 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d9efa1cd-d1bb-441d-9083-8584d00d7420 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:37.734934 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d9efa1cd-d1bb-441d-9083-8584d00d7420 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:37.735371 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d9efa1cd-d1bb-441d-9083-8584d00d7420 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:37.736053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d9efa1cd-d1bb-441d-9083-8584d00d7420 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:37.736528 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d9efa1cd-d1bb-441d-9083-8584d00d7420 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:37.736943 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d9efa1cd-d1bb-441d-9083-8584d00d7420 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:37.865332 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d9efa1cd-d1bb-441d-9083-8584d00d7420 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:37.874251 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d9efa1cd-d1bb-441d-9083-8584d00d7420 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:37.875889 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d9efa1cd-d1bb-441d-9083-8584d00d7420 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:55:37.877157 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d9efa1cd-d1bb-441d-9083-8584d00d7420 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1597 microversion: 2.20 time: 0.157985 Oct 30 00:55:37.877807 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 371/760] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:55:37 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1597 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:55:37.901748 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-a6105999-876a-4aa5-acd9-ed57d72da050 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:55:37.902270 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-a6105999-876a-4aa5-acd9-ed57d72da050 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:55:37.904189 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=6 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:55:37.910143 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a6105999-876a-4aa5-acd9-ed57d72da050 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:37.910626 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a6105999-876a-4aa5-acd9-ed57d72da050 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:37.911049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a6105999-876a-4aa5-acd9-ed57d72da050 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:37.911726 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a6105999-876a-4aa5-acd9-ed57d72da050 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:37.912227 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a6105999-876a-4aa5-acd9-ed57d72da050 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:37.912641 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a6105999-876a-4aa5-acd9-ed57d72da050 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:37.993500 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-a6105999-876a-4aa5-acd9-ed57d72da050 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095538 Oct 30 00:55:37.994291 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 390/761] 10.222.0.36 () {60 vars in 1316 bytes} [Sun Oct 30 00:55:37 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:55:38.935032 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-dec5ab8b-ee6b-46db-be95-96010b13a679 req-2f6eb0a5-39ac-4d12-b722-6503053fdce1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f745c72f-1429-408f-bbf6-9d254529e9b3", "tag": "d3536290-43b6-4818-9024-5c42427edf8f"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:55:38.945861 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-dec5ab8b-ee6b-46db-be95-96010b13a679 req-2f6eb0a5-39ac-4d12-b722-6503053fdce1 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:55:38.946334 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-dec5ab8b-ee6b-46db-be95-96010b13a679 req-2f6eb0a5-39ac-4d12-b722-6503053fdce1 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:55:38.946754 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-dec5ab8b-ee6b-46db-be95-96010b13a679 req-2f6eb0a5-39ac-4d12-b722-6503053fdce1 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:55:38.959062 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-dec5ab8b-ee6b-46db-be95-96010b13a679 req-2f6eb0a5-39ac-4d12-b722-6503053fdce1 service nova] Creating event network-changed:d3536290-43b6-4818-9024-5c42427edf8f for instance f745c72f-1429-408f-bbf6-9d254529e9b3 on hv-cinder-86149 Oct 30 00:55:38.964259 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-dec5ab8b-ee6b-46db-be95-96010b13a679 req-2f6eb0a5-39ac-4d12-b722-6503053fdce1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032691 Oct 30 00:55:38.964861 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 372/762] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:56:04.159780 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:04.160597 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:04.165010 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b4ad980c-6181-41e1-8717-0abc28826508 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:04.165555 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-b4ad980c-6181-41e1-8717-0abc28826508 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:04.173400 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b4ad980c-6181-41e1-8717-0abc28826508 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:04.174019 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b4ad980c-6181-41e1-8717-0abc28826508 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:04.174558 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b4ad980c-6181-41e1-8717-0abc28826508 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:04.175241 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b4ad980c-6181-41e1-8717-0abc28826508 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:04.175687 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b4ad980c-6181-41e1-8717-0abc28826508 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:04.176163 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b4ad980c-6181-41e1-8717-0abc28826508 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:04.257953 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.objects.instance [None req-b4ad980c-6181-41e1-8717-0abc28826508 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lazy-loading 'services' on Instance uuid a3538515-fbfd-4f28-bc94-dd5e63e10656 {{(pid=125554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:56:04.330833 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b4ad980c-6181-41e1-8717-0abc28826508 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656/os-volume_attachments/362ec2dd-f777-4ee1-9943-7f3d1eb624e2" status: 202 len: 0 microversion: 2.1 time: 0.173708 Oct 30 00:56:04.331770 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 391/763] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Oct 30 00:56:04 2022] DELETE /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656/os-volume_attachments/362ec2dd-f777-4ee1-9943-7f3d1eb624e2 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 00:56:04.337977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:04.338717 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=96 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:04.342967 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-91d48acb-bf42-4614-bd51-e3d5d1819c7c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:04.346049 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-91d48acb-bf42-4614-bd51-e3d5d1819c7c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:04.353303 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-91d48acb-bf42-4614-bd51-e3d5d1819c7c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:04.353787 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-91d48acb-bf42-4614-bd51-e3d5d1819c7c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:04.354232 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-91d48acb-bf42-4614-bd51-e3d5d1819c7c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:04.354932 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-91d48acb-bf42-4614-bd51-e3d5d1819c7c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:04.355421 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-91d48acb-bf42-4614-bd51-e3d5d1819c7c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:04.355842 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-91d48acb-bf42-4614-bd51-e3d5d1819c7c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:04.387200 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-91d48acb-bf42-4614-bd51-e3d5d1819c7c tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050749 Oct 30 00:56:04.387681 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 373/764] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Oct 30 00:56:04 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:56:05.401227 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-851969d6-dba2-4a41-9b7e-1be6d530e3d9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:05.403531 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-851969d6-dba2-4a41-9b7e-1be6d530e3d9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:05.410285 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-851969d6-dba2-4a41-9b7e-1be6d530e3d9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:05.410758 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-851969d6-dba2-4a41-9b7e-1be6d530e3d9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:05.411185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-851969d6-dba2-4a41-9b7e-1be6d530e3d9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:05.411868 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-851969d6-dba2-4a41-9b7e-1be6d530e3d9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:05.412355 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-851969d6-dba2-4a41-9b7e-1be6d530e3d9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:05.412773 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-851969d6-dba2-4a41-9b7e-1be6d530e3d9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:05.442250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-851969d6-dba2-4a41-9b7e-1be6d530e3d9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045316 Oct 30 00:56:05.442794 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 392/765] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Oct 30 00:56:05 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 00:56:05.519668 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-4b6e025b-19a9-43d4-ad51-ef986b8bfcfd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:05.520233 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-4b6e025b-19a9-43d4-ad51-ef986b8bfcfd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:05.526294 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4b6e025b-19a9-43d4-ad51-ef986b8bfcfd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:05.526775 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4b6e025b-19a9-43d4-ad51-ef986b8bfcfd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:05.527215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4b6e025b-19a9-43d4-ad51-ef986b8bfcfd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:05.527905 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4b6e025b-19a9-43d4-ad51-ef986b8bfcfd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:05.528407 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4b6e025b-19a9-43d4-ad51-ef986b8bfcfd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:05.528838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4b6e025b-19a9-43d4-ad51-ef986b8bfcfd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:05.553709 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-4b6e025b-19a9-43d4-ad51-ef986b8bfcfd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Going to try to terminate instance {{(pid=125553) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 00:56:05.630312 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-4b6e025b-19a9-43d4-ad51-ef986b8bfcfd tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 204 len: 0 microversion: 2.1 time: 0.114320 Oct 30 00:56:05.630904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 374/766] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 00:56:05 2022] DELETE /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 00:56:05.639204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-76b1b139-bbdd-404c-b615-6404eff6e693 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:05.639810 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-76b1b139-bbdd-404c-b615-6404eff6e693 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:05.645812 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-76b1b139-bbdd-404c-b615-6404eff6e693 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:05.646288 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-76b1b139-bbdd-404c-b615-6404eff6e693 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:05.646718 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-76b1b139-bbdd-404c-b615-6404eff6e693 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:05.647400 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-76b1b139-bbdd-404c-b615-6404eff6e693 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:05.647848 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-76b1b139-bbdd-404c-b615-6404eff6e693 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:05.648398 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-76b1b139-bbdd-404c-b615-6404eff6e693 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:05.784006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-76b1b139-bbdd-404c-b615-6404eff6e693 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:05.792120 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-76b1b139-bbdd-404c-b615-6404eff6e693 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1688 microversion: 2.1 time: 0.157060 Oct 30 00:56:05.792681 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 393/767] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:05 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:06.817021 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-7c8c1ef2-3d1c-404b-b7db-bcbe602ed94b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:06.817710 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-7c8c1ef2-3d1c-404b-b7db-bcbe602ed94b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:06.824124 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7c8c1ef2-3d1c-404b-b7db-bcbe602ed94b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:06.824609 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7c8c1ef2-3d1c-404b-b7db-bcbe602ed94b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:06.825040 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7c8c1ef2-3d1c-404b-b7db-bcbe602ed94b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:06.825726 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7c8c1ef2-3d1c-404b-b7db-bcbe602ed94b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:06.826174 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7c8c1ef2-3d1c-404b-b7db-bcbe602ed94b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:06.826595 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7c8c1ef2-3d1c-404b-b7db-bcbe602ed94b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:06.956394 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-7c8c1ef2-3d1c-404b-b7db-bcbe602ed94b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:06.964420 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-7c8c1ef2-3d1c-404b-b7db-bcbe602ed94b tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1688 microversion: 2.1 time: 0.151924 Oct 30 00:56:06.965019 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 375/768] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:06 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:56:07.988340 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2c9d3cfa-e1fe-4286-a333-5067ff372ef9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:07.988869 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2c9d3cfa-e1fe-4286-a333-5067ff372ef9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:07.995407 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2c9d3cfa-e1fe-4286-a333-5067ff372ef9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:07.995888 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2c9d3cfa-e1fe-4286-a333-5067ff372ef9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:07.996347 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2c9d3cfa-e1fe-4286-a333-5067ff372ef9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:07.997027 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2c9d3cfa-e1fe-4286-a333-5067ff372ef9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:07.997471 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2c9d3cfa-e1fe-4286-a333-5067ff372ef9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:07.997888 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2c9d3cfa-e1fe-4286-a333-5067ff372ef9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:08.130494 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2c9d3cfa-e1fe-4286-a333-5067ff372ef9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:08.138378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2c9d3cfa-e1fe-4286-a333-5067ff372ef9 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1688 microversion: 2.1 time: 0.154231 Oct 30 00:56:08.138980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 394/769] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:07 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:09.162560 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-ea72fe60-5f8f-4527-b162-392e23f24f13 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:09.163157 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-ea72fe60-5f8f-4527-b162-392e23f24f13 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:09.169583 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea72fe60-5f8f-4527-b162-392e23f24f13 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:09.170059 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea72fe60-5f8f-4527-b162-392e23f24f13 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:09.170486 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea72fe60-5f8f-4527-b162-392e23f24f13 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:09.171168 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea72fe60-5f8f-4527-b162-392e23f24f13 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:09.171616 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea72fe60-5f8f-4527-b162-392e23f24f13 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:09.172029 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea72fe60-5f8f-4527-b162-392e23f24f13 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:09.299956 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ea72fe60-5f8f-4527-b162-392e23f24f13 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:09.308174 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-ea72fe60-5f8f-4527-b162-392e23f24f13 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1688 microversion: 2.1 time: 0.149471 Oct 30 00:56:09.308732 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 376/770] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:09 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:10.260793 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-0c592804-5f6e-4238-9edc-953355f17c5d req-81a4f8f5-cc4e-489b-9d42-accafa8805c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3538515-fbfd-4f28-bc94-dd5e63e10656", "name": "network-vif-deleted", "tag": "8a1c5189-8d93-4813-95d3-4fdc06d11a80"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:56:10.280703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-0c592804-5f6e-4238-9edc-953355f17c5d req-81a4f8f5-cc4e-489b-9d42-accafa8805c4 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:10.281310 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-0c592804-5f6e-4238-9edc-953355f17c5d req-81a4f8f5-cc4e-489b-9d42-accafa8805c4 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:10.281782 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-0c592804-5f6e-4238-9edc-953355f17c5d req-81a4f8f5-cc4e-489b-9d42-accafa8805c4 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:10.297240 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-0c592804-5f6e-4238-9edc-953355f17c5d req-81a4f8f5-cc4e-489b-9d42-accafa8805c4 service nova] Creating event network-vif-deleted:8a1c5189-8d93-4813-95d3-4fdc06d11a80 for instance a3538515-fbfd-4f28-bc94-dd5e63e10656 on hv-cinder-86149 Oct 30 00:56:10.305247 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-0c592804-5f6e-4238-9edc-953355f17c5d req-81a4f8f5-cc4e-489b-9d42-accafa8805c4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047824 Oct 30 00:56:10.306264 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 395/771] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:56:10.335743 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-439c1a1a-5545-4e8e-893a-4a0a8016fa50 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:10.336387 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-439c1a1a-5545-4e8e-893a-4a0a8016fa50 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:10.343488 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-439c1a1a-5545-4e8e-893a-4a0a8016fa50 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:10.344149 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-439c1a1a-5545-4e8e-893a-4a0a8016fa50 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:10.345448 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-439c1a1a-5545-4e8e-893a-4a0a8016fa50 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:10.346755 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-439c1a1a-5545-4e8e-893a-4a0a8016fa50 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:10.347381 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-439c1a1a-5545-4e8e-893a-4a0a8016fa50 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:10.348154 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-439c1a1a-5545-4e8e-893a-4a0a8016fa50 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:10.417916 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-439c1a1a-5545-4e8e-893a-4a0a8016fa50 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:10.428573 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-439c1a1a-5545-4e8e-893a-4a0a8016fa50 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 200 len: 1329 microversion: 2.1 time: 0.099499 Oct 30 00:56:10.429174 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 377/772] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:10 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 1329 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:11.458546 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-59ca8cea-4d31-4e49-8fb5-b8aa5f873a3d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:11.459267 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-59ca8cea-4d31-4e49-8fb5-b8aa5f873a3d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a3538515-fbfd-4f28-bc94-dd5e63e10656] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:11.466332 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-59ca8cea-4d31-4e49-8fb5-b8aa5f873a3d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:11.466812 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-59ca8cea-4d31-4e49-8fb5-b8aa5f873a3d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:11.467240 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-59ca8cea-4d31-4e49-8fb5-b8aa5f873a3d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:11.467933 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-59ca8cea-4d31-4e49-8fb5-b8aa5f873a3d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:11.468402 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-59ca8cea-4d31-4e49-8fb5-b8aa5f873a3d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:11.468819 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-59ca8cea-4d31-4e49-8fb5-b8aa5f873a3d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:11.484358 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-59ca8cea-4d31-4e49-8fb5-b8aa5f873a3d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] HTTP exception thrown: Instance a3538515-fbfd-4f28-bc94-dd5e63e10656 could not be found. Oct 30 00:56:11.486099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-59ca8cea-4d31-4e49-8fb5-b8aa5f873a3d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Request method failure captured: Oct 30 00:56:11.486099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 HTTP/1.1 Oct 30 00:56:11.486099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 00:56:11.486099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 00:56:11.486099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 00:56:11.486099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 00:56:11.486099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 00:56:11.486099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 00:56:11.486099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 00:56:11.486099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 00:56:11.486099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcncHN2FMp3GekPAJgW2lCHVpFVD1HiGRi_JOqMmQ-PfVilNLgfwWcxx70_iLo4vYd7UAj8igq__hURJYEWmtmOEe5lhexivbbch2YCwcd0s6St00YrnBHRVHxJNmHDYhZsFh2ymNYkM6Kt17ecfK_bdNW7N1EoLE8TulhKSa2LJfPY Oct 30 00:56:11.486099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 00:56:11.486099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 00:56:11.486099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 00:56:11.486099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 00:56:11.486099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 00:56:11.486099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 00:56:11.486099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: 999d27163d544dff836ab7d90355f0d6 Oct 30 00:56:11.486099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-661451104 Oct 30 00:56:11.486099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 00:56:11.486099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 00:56:11.487861 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_999d27163d544dff836ab7d90355f0d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/999d27163d544dff836ab7d90355f0d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/999d27163d544dff836ab7d90355f0d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/999d27163d544dff836ab7d90355f0d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:56:11.487861 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-ServerRescueNegativeTestJSON-661451104 Oct 30 00:56:11.487861 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: 999d27163d544dff836ab7d90355f0d6 Oct 30 00:56:11.487861 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-661451104 Oct 30 00:56:11.487861 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-ServerRescueNegativeTestJSON-661451104-project Oct 30 00:56:11.487861 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 00:56:11.487861 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 00:56:11.487861 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 350f5e4238f448949b2c372aabbfc835 Oct 30 00:56:11.487861 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-ServerRescueNegativeTestJSON-661451104-project Oct 30 00:56:11.487861 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 00:56:11.487861 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Instance a3538515-fbfd-4f28-bc94-dd5e63e10656 could not be found. Oct 30 00:56:11.487861 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': 'a3538515-fbfd-4f28-bc94-dd5e63e10656'} Oct 30 00:56:11.488993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:56:11.488993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:11.488993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:56:11.488993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:56:11.488993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:56:11.488993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:56:11.488993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:56:11.488993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:56:11.488993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:56:11.488993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:56:11.488993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3538515-fbfd-4f28-bc94-dd5e63e10656 could not be found. Oct 30 00:56:11.488993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:11.488993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:11.488993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:11.488993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:11.488993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:56:11.488993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:56:11.488993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:56:11.488993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:56:11.488993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:56:11.490760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:56:11.490760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 00:56:11.490760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 00:56:11.490760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:56:11.490760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:56:11.490760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:56:11.490760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:56:11.490760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3538515-fbfd-4f28-bc94-dd5e63e10656 could not be found. Oct 30 00:56:11.490760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:11.490760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:11.490760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:11.490760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:11.490760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:56:11.490760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:56:11.490760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:56:11.490760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:56:11.490760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3538515-fbfd-4f28-bc94-dd5e63e10656 could not be found. Oct 30 00:56:11.490760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:11.492314 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-59ca8cea-4d31-4e49-8fb5-b8aa5f873a3d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Returning 404 to user: Instance a3538515-fbfd-4f28-bc94-dd5e63e10656 could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:56:11.492314 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-59ca8cea-4d31-4e49-8fb5-b8aa5f873a3d tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656" status: 404 len: 111 microversion: 2.1 time: 0.034590 Oct 30 00:56:11.492314 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 396/773] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:11 2022] GET /compute/v2.1/servers/a3538515-fbfd-4f28-bc94-dd5e63e10656 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 00:56:11.496725 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-fe5972bb-70e5-4095-88a3-3225fe1b4e3a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '.version_select at 0x7faf75ac8160>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:11.517343 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-fe5972bb-70e5-4095-88a3-3225fe1b4e3a tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-67297937" status: 202 len: 0 microversion: 2.1 time: 0.024029 Oct 30 00:56:11.518092 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 378/774] 10.222.0.36 () {58 vars in 1215 bytes} [Sun Oct 30 00:56:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-67297937 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 00:56:14.386754 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-5048f053-fe5a-45bf-bd22-9585f2da69f7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:14.387260 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-5048f053-fe5a-45bf-bd22-9585f2da69f7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:14.393507 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5048f053-fe5a-45bf-bd22-9585f2da69f7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:14.393981 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5048f053-fe5a-45bf-bd22-9585f2da69f7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:14.394412 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5048f053-fe5a-45bf-bd22-9585f2da69f7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:14.395202 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5048f053-fe5a-45bf-bd22-9585f2da69f7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:14.395646 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5048f053-fe5a-45bf-bd22-9585f2da69f7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:14.396064 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5048f053-fe5a-45bf-bd22-9585f2da69f7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:14.421141 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-5048f053-fe5a-45bf-bd22-9585f2da69f7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Going to try to terminate instance {{(pid=125554) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 00:56:14.495619 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-5048f053-fe5a-45bf-bd22-9585f2da69f7 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 204 len: 0 microversion: 2.1 time: 0.112279 Oct 30 00:56:14.496343 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 397/775] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 00:56:14 2022] DELETE /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 00:56:14.506902 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1968ef99-622c-4581-b8e1-c405023cad42 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:14.507545 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1968ef99-622c-4581-b8e1-c405023cad42 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:14.514170 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1968ef99-622c-4581-b8e1-c405023cad42 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:14.514657 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1968ef99-622c-4581-b8e1-c405023cad42 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:14.515090 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1968ef99-622c-4581-b8e1-c405023cad42 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:14.515808 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1968ef99-622c-4581-b8e1-c405023cad42 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:14.516288 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1968ef99-622c-4581-b8e1-c405023cad42 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:14.517208 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1968ef99-622c-4581-b8e1-c405023cad42 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:14.647765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1968ef99-622c-4581-b8e1-c405023cad42 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:14.655571 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1968ef99-622c-4581-b8e1-c405023cad42 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1507 microversion: 2.1 time: 0.154433 Oct 30 00:56:14.656150 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 379/776] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:14 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:56:15.680106 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-33c52740-da18-47c4-91b1-60625c0990ad tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:15.680805 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-33c52740-da18-47c4-91b1-60625c0990ad tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:15.687035 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-33c52740-da18-47c4-91b1-60625c0990ad tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:15.687514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-33c52740-da18-47c4-91b1-60625c0990ad tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:15.687953 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-33c52740-da18-47c4-91b1-60625c0990ad tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:15.689277 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-33c52740-da18-47c4-91b1-60625c0990ad tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:15.689876 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-33c52740-da18-47c4-91b1-60625c0990ad tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:15.690282 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-33c52740-da18-47c4-91b1-60625c0990ad tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:15.822212 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-33c52740-da18-47c4-91b1-60625c0990ad tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:15.831966 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-33c52740-da18-47c4-91b1-60625c0990ad tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 200 len: 1507 microversion: 2.1 time: 0.156074 Oct 30 00:56:15.832618 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 398/777] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:15 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:15.989307 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-f9879af8-5f24-4b63-8c19-5ac960ef55f5 req-1c4dd460-6a2e-4c31-af3b-ee2357bc3b1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc267534-c882-4793-a8f9-17df60c7fa64", "name": "network-vif-deleted", "tag": "7ec2e88e-6952-48c2-a06d-48ad36a8fe11"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:56:16.002236 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-f9879af8-5f24-4b63-8c19-5ac960ef55f5 req-1c4dd460-6a2e-4c31-af3b-ee2357bc3b1f service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:16.003202 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-f9879af8-5f24-4b63-8c19-5ac960ef55f5 req-1c4dd460-6a2e-4c31-af3b-ee2357bc3b1f service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:16.003656 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-f9879af8-5f24-4b63-8c19-5ac960ef55f5 req-1c4dd460-6a2e-4c31-af3b-ee2357bc3b1f service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:16.016899 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-f9879af8-5f24-4b63-8c19-5ac960ef55f5 req-1c4dd460-6a2e-4c31-af3b-ee2357bc3b1f service nova] Creating event network-vif-deleted:7ec2e88e-6952-48c2-a06d-48ad36a8fe11 for instance fc267534-c882-4793-a8f9-17df60c7fa64 on hv-cinder-86149 Oct 30 00:56:16.023094 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-f9879af8-5f24-4b63-8c19-5ac960ef55f5 req-1c4dd460-6a2e-4c31-af3b-ee2357bc3b1f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040203 Oct 30 00:56:16.023693 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 380/778] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:56:16.854589 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-8c8bb536-71af-4094-97bf-3e0344f64cfe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:16.855197 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-8c8bb536-71af-4094-97bf-3e0344f64cfe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: fc267534-c882-4793-a8f9-17df60c7fa64] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:16.861708 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8c8bb536-71af-4094-97bf-3e0344f64cfe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:16.862132 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8c8bb536-71af-4094-97bf-3e0344f64cfe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:16.862566 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8c8bb536-71af-4094-97bf-3e0344f64cfe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:16.863256 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8c8bb536-71af-4094-97bf-3e0344f64cfe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:16.863707 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8c8bb536-71af-4094-97bf-3e0344f64cfe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:16.864162 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8c8bb536-71af-4094-97bf-3e0344f64cfe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:16.879441 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-8c8bb536-71af-4094-97bf-3e0344f64cfe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] HTTP exception thrown: Instance fc267534-c882-4793-a8f9-17df60c7fa64 could not be found. Oct 30 00:56:16.881113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-8c8bb536-71af-4094-97bf-3e0344f64cfe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Request method failure captured: Oct 30 00:56:16.881113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 HTTP/1.1 Oct 30 00:56:16.881113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 00:56:16.881113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 00:56:16.881113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 00:56:16.881113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 00:56:16.881113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 00:56:16.881113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 00:56:16.881113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 00:56:16.881113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 00:56:16.881113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcncHN2FMp3GekPAJgW2lCHVpFVD1HiGRi_JOqMmQ-PfVilNLgfwWcxx70_iLo4vYd7UAj8igq__hURJYEWmtmOEe5lhexivbbch2YCwcd0s6St00YrnBHRVHxJNmHDYhZsFh2ymNYkM6Kt17ecfK_bdNW7N1EoLE8TulhKSa2LJfPY Oct 30 00:56:16.881113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 00:56:16.881113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 00:56:16.881113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 00:56:16.881113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 00:56:16.881113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 00:56:16.881113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 00:56:16.881113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: 999d27163d544dff836ab7d90355f0d6 Oct 30 00:56:16.881113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-661451104 Oct 30 00:56:16.881113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 00:56:16.881113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 00:56:16.882659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_999d27163d544dff836ab7d90355f0d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/999d27163d544dff836ab7d90355f0d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/999d27163d544dff836ab7d90355f0d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/999d27163d544dff836ab7d90355f0d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:56:16.882659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-ServerRescueNegativeTestJSON-661451104 Oct 30 00:56:16.882659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: 999d27163d544dff836ab7d90355f0d6 Oct 30 00:56:16.882659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-661451104 Oct 30 00:56:16.882659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-ServerRescueNegativeTestJSON-661451104-project Oct 30 00:56:16.882659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 00:56:16.882659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 00:56:16.882659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 350f5e4238f448949b2c372aabbfc835 Oct 30 00:56:16.882659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-ServerRescueNegativeTestJSON-661451104-project Oct 30 00:56:16.882659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 00:56:16.882659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Instance fc267534-c882-4793-a8f9-17df60c7fa64 could not be found. Oct 30 00:56:16.882659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': 'fc267534-c882-4793-a8f9-17df60c7fa64'} Oct 30 00:56:16.883569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:56:16.883569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:16.883569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:56:16.883569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:56:16.883569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:56:16.883569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:56:16.883569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:56:16.883569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:56:16.883569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:56:16.883569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:56:16.883569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc267534-c882-4793-a8f9-17df60c7fa64 could not be found. Oct 30 00:56:16.883569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:16.883569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:16.883569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:16.883569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:16.883569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:56:16.883569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:56:16.883569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:56:16.883569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:56:16.883569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:56:16.885011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:56:16.885011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 00:56:16.885011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 00:56:16.885011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:56:16.885011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:56:16.885011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:56:16.885011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:56:16.885011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc267534-c882-4793-a8f9-17df60c7fa64 could not be found. Oct 30 00:56:16.885011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:16.885011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:16.885011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:16.885011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:16.885011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:56:16.885011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:56:16.885011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:56:16.885011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:56:16.885011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc267534-c882-4793-a8f9-17df60c7fa64 could not be found. Oct 30 00:56:16.885011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:16.886363 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-8c8bb536-71af-4094-97bf-3e0344f64cfe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Returning 404 to user: Instance fc267534-c882-4793-a8f9-17df60c7fa64 could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:56:16.886363 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-8c8bb536-71af-4094-97bf-3e0344f64cfe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64" status: 404 len: 111 microversion: 2.1 time: 0.031770 Oct 30 00:56:16.886363 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 399/779] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:16 2022] GET /compute/v2.1/servers/fc267534-c882-4793-a8f9-17df60c7fa64 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 00:56:16.892337 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1a7ae558-a4ac-4493-89a3-076e2fd4c9fe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:16.893012 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1a7ae558-a4ac-4493-89a3-076e2fd4c9fe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:16.899167 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a7ae558-a4ac-4493-89a3-076e2fd4c9fe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:16.899649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a7ae558-a4ac-4493-89a3-076e2fd4c9fe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:16.900095 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a7ae558-a4ac-4493-89a3-076e2fd4c9fe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:16.900808 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a7ae558-a4ac-4493-89a3-076e2fd4c9fe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:16.901259 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a7ae558-a4ac-4493-89a3-076e2fd4c9fe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:16.901680 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a7ae558-a4ac-4493-89a3-076e2fd4c9fe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:16.926725 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1a7ae558-a4ac-4493-89a3-076e2fd4c9fe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Going to try to terminate instance {{(pid=125553) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 00:56:17.002823 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1a7ae558-a4ac-4493-89a3-076e2fd4c9fe tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 204 len: 0 microversion: 2.1 time: 0.114877 Oct 30 00:56:17.003535 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 381/780] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 00:56:16 2022] DELETE /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 00:56:17.011278 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-9dff540c-5ea1-4509-91a2-225c44a8e0a6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:17.011884 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-9dff540c-5ea1-4509-91a2-225c44a8e0a6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:17.018341 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9dff540c-5ea1-4509-91a2-225c44a8e0a6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:17.018819 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9dff540c-5ea1-4509-91a2-225c44a8e0a6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:17.019257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9dff540c-5ea1-4509-91a2-225c44a8e0a6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:17.019942 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9dff540c-5ea1-4509-91a2-225c44a8e0a6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:17.020430 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9dff540c-5ea1-4509-91a2-225c44a8e0a6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:17.020848 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9dff540c-5ea1-4509-91a2-225c44a8e0a6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:17.150945 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9dff540c-5ea1-4509-91a2-225c44a8e0a6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:17.158869 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-9dff540c-5ea1-4509-91a2-225c44a8e0a6 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1520 microversion: 2.1 time: 0.151506 Oct 30 00:56:17.159422 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 400/781] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:17 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:56:18.181479 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-bd41118f-6d17-45f6-9392-52b2f1d24b61 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:18.182174 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-bd41118f-6d17-45f6-9392-52b2f1d24b61 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:18.188582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bd41118f-6d17-45f6-9392-52b2f1d24b61 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:18.189747 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bd41118f-6d17-45f6-9392-52b2f1d24b61 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:18.190185 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bd41118f-6d17-45f6-9392-52b2f1d24b61 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:18.190878 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bd41118f-6d17-45f6-9392-52b2f1d24b61 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:18.191336 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bd41118f-6d17-45f6-9392-52b2f1d24b61 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:18.191762 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bd41118f-6d17-45f6-9392-52b2f1d24b61 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:18.329248 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-bd41118f-6d17-45f6-9392-52b2f1d24b61 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '350f5e4238f448949b2c372aabbfc835', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '999d27163d544dff836ab7d90355f0d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:18.337812 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-bd41118f-6d17-45f6-9392-52b2f1d24b61 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 200 len: 1520 microversion: 2.1 time: 0.160445 Oct 30 00:56:18.338576 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 382/782] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:18 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:18.679770 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-f88ac26c-2fd0-418b-82ad-d9f00c470317 req-69ec975a-8b06-4b3c-8d32-0bc1d8860e36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1bf0cdf-a838-4e0c-a56f-707f90711978", "name": "network-vif-deleted", "tag": "1a9df18b-56de-4bc7-8368-87528ddf8143"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:56:18.692415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-f88ac26c-2fd0-418b-82ad-d9f00c470317 req-69ec975a-8b06-4b3c-8d32-0bc1d8860e36 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:18.693184 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-f88ac26c-2fd0-418b-82ad-d9f00c470317 req-69ec975a-8b06-4b3c-8d32-0bc1d8860e36 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:18.693611 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-f88ac26c-2fd0-418b-82ad-d9f00c470317 req-69ec975a-8b06-4b3c-8d32-0bc1d8860e36 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:18.706250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-f88ac26c-2fd0-418b-82ad-d9f00c470317 req-69ec975a-8b06-4b3c-8d32-0bc1d8860e36 service nova] Creating event network-vif-deleted:1a9df18b-56de-4bc7-8368-87528ddf8143 for instance a1bf0cdf-a838-4e0c-a56f-707f90711978 on hv-cinder-86149 Oct 30 00:56:18.711545 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-f88ac26c-2fd0-418b-82ad-d9f00c470317 req-69ec975a-8b06-4b3c-8d32-0bc1d8860e36 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035291 Oct 30 00:56:18.716930 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 401/783] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 00:56:19.360918 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f4e6b2fe-3b4e-4066-9736-fee06d526a69 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:19.361703 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f4e6b2fe-3b4e-4066-9736-fee06d526a69 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] [instance: a1bf0cdf-a838-4e0c-a56f-707f90711978] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:19.368408 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f4e6b2fe-3b4e-4066-9736-fee06d526a69 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:19.368996 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f4e6b2fe-3b4e-4066-9736-fee06d526a69 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:19.369498 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f4e6b2fe-3b4e-4066-9736-fee06d526a69 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:19.370197 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f4e6b2fe-3b4e-4066-9736-fee06d526a69 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:19.370650 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f4e6b2fe-3b4e-4066-9736-fee06d526a69 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:19.371071 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f4e6b2fe-3b4e-4066-9736-fee06d526a69 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:19.385659 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-f4e6b2fe-3b4e-4066-9736-fee06d526a69 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] HTTP exception thrown: Instance a1bf0cdf-a838-4e0c-a56f-707f90711978 could not be found. Oct 30 00:56:19.387300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f4e6b2fe-3b4e-4066-9736-fee06d526a69 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Request method failure captured: Oct 30 00:56:19.387300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 HTTP/1.1 Oct 30 00:56:19.387300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 00:56:19.387300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 00:56:19.387300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 00:56:19.387300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 00:56:19.387300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 00:56:19.387300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 00:56:19.387300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 00:56:19.387300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 00:56:19.387300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXcncHN2FMp3GekPAJgW2lCHVpFVD1HiGRi_JOqMmQ-PfVilNLgfwWcxx70_iLo4vYd7UAj8igq__hURJYEWmtmOEe5lhexivbbch2YCwcd0s6St00YrnBHRVHxJNmHDYhZsFh2ymNYkM6Kt17ecfK_bdNW7N1EoLE8TulhKSa2LJfPY Oct 30 00:56:19.387300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 00:56:19.387300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 00:56:19.387300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 00:56:19.387300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 00:56:19.387300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 00:56:19.387300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 00:56:19.387300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: 999d27163d544dff836ab7d90355f0d6 Oct 30 00:56:19.387300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-661451104 Oct 30 00:56:19.387300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 00:56:19.387300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 00:56:19.388887 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_999d27163d544dff836ab7d90355f0d6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/999d27163d544dff836ab7d90355f0d6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/999d27163d544dff836ab7d90355f0d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/999d27163d544dff836ab7d90355f0d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:56:19.388887 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-ServerRescueNegativeTestJSON-661451104 Oct 30 00:56:19.388887 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: 999d27163d544dff836ab7d90355f0d6 Oct 30 00:56:19.388887 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-661451104 Oct 30 00:56:19.388887 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-ServerRescueNegativeTestJSON-661451104-project Oct 30 00:56:19.388887 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 00:56:19.388887 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 00:56:19.388887 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: 350f5e4238f448949b2c372aabbfc835 Oct 30 00:56:19.388887 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-ServerRescueNegativeTestJSON-661451104-project Oct 30 00:56:19.388887 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: > Oct 30 00:56:19.388887 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Instance a1bf0cdf-a838-4e0c-a56f-707f90711978 could not be found. Oct 30 00:56:19.388887 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': 'a1bf0cdf-a838-4e0c-a56f-707f90711978'} Oct 30 00:56:19.389765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:56:19.389765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:19.389765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:56:19.389765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:56:19.389765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:56:19.389765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:56:19.389765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:56:19.389765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:56:19.389765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:56:19.389765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:56:19.389765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1bf0cdf-a838-4e0c-a56f-707f90711978 could not be found. Oct 30 00:56:19.389765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:19.389765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:19.389765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:19.389765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:19.389765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:56:19.389765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:56:19.389765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:56:19.389765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:56:19.389765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:56:19.391283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:56:19.391283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 00:56:19.391283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 00:56:19.391283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:56:19.391283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:56:19.391283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:56:19.391283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:56:19.391283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1bf0cdf-a838-4e0c-a56f-707f90711978 could not be found. Oct 30 00:56:19.391283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:19.391283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:19.391283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:19.391283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:19.391283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:56:19.391283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:56:19.391283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:56:19.391283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:56:19.391283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1bf0cdf-a838-4e0c-a56f-707f90711978 could not be found. Oct 30 00:56:19.391283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:19.392590 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f4e6b2fe-3b4e-4066-9736-fee06d526a69 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] Returning 404 to user: Instance a1bf0cdf-a838-4e0c-a56f-707f90711978 could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:56:19.392590 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f4e6b2fe-3b4e-4066-9736-fee06d526a69 tempest-ServerRescueNegativeTestJSON-661451104 tempest-ServerRescueNegativeTestJSON-661451104-project] 10.222.0.36 "GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978" status: 404 len: 111 microversion: 2.1 time: 0.031672 Oct 30 00:56:19.392590 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 383/784] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:19 2022] GET /compute/v2.1/servers/a1bf0cdf-a838-4e0c-a56f-707f90711978 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 00:56:24.275333 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f66fb4ba-c9d6-46ef-8b7a-7b0065b50f37 tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] Action: 'create', calling method: .version_select at 0x7faf792ef820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1107136980", "metadata": {"Type": "work"}}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:56:24.301604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f66fb4ba-c9d6-46ef-8b7a-7b0065b50f37 tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] Request method failure captured: Oct 30 00:56:24.301604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 30 00:56:24.301604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 00:56:24.301604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 00:56:24.301604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 00:56:24.301604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 122 Oct 30 00:56:24.301604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 00:56:24.301604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 00:56:24.301604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 00:56:24.301604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 00:56:24.301604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcu4hV6KjCK82phh6c1_ABLrJnJsaG--3_pdoyG4K9E2gbLPWH19NmmTyLoE_AjfmD34aRUvwQ6K3I87URSuYVkplPvWvz-MCwA45u0YgvJzIux0Bj-T3HR0WemgCPrtLE3NcMFPw0VjeuQB7AZk06cPhqDV5Aule7kqLqEUvb9bnK0 Oct 30 00:56:24.301604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 00:56:24.301604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 00:56:24.301604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 00:56:24.301604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 00:56:24.301604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 00:56:24.301604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 00:56:24.301604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: c9d7c91873be42cfbad24838de99e145 Oct 30 00:56:24.301604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-VolumesNegativeTest-1119018459 Oct 30 00:56:24.301604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 00:56:24.301604 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 00:56:24.303204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c9d7c91873be42cfbad24838de99e145"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c9d7c91873be42cfbad24838de99e145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c9d7c91873be42cfbad24838de99e145"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c9d7c91873be42cfbad24838de99e145"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:56:24.303204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-VolumesNegativeTest-1119018459 Oct 30 00:56:24.303204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: c9d7c91873be42cfbad24838de99e145 Oct 30 00:56:24.303204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-VolumesNegativeTest-1119018459 Oct 30 00:56:24.303204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-VolumesNegativeTest-1119018459-project Oct 30 00:56:24.303204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 00:56:24.303204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 00:56:24.303204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 884aac2daddd438b96d16553e8805fd9 Oct 30 00:56:24.303204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-VolumesNegativeTest-1119018459-project Oct 30 00:56:24.303204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Oct 30 00:56:24.303204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1107136980", "metadata": {"Type": "work"}}} Oct 30 00:56:24.303204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: Oct 30 00:56:24.303204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 30 00:56:24.304215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1107136980', 'metadata': {'Type': 'work'}}}} Oct 30 00:56:24.304215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:56:24.304215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:24.304215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 00:56:24.304215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 00:56:24.304215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 00:56:24.304215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise error Oct 30 00:56:24.304215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 30 00:56:24.304215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.304215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 30 00:56:24.304215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 30 00:56:24.304215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.304215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 30 00:56:24.304215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi '#$%' Oct 30 00:56:24.304215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.304215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:24.304215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.304215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:24.304215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:56:24.304215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:56:24.304215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:56:24.304215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:56:24.305608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 00:56:24.305608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 00:56:24.305608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:56:24.305608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:56:24.305608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 00:56:24.305608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 00:56:24.305608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 00:56:24.305608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 00:56:24.305608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 00:56:24.305608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 00:56:24.305608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 30 00:56:24.305608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.305608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:24.305608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.305608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:24.305608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:56:24.305608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:56:24.305608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 00:56:24.305608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 00:56:24.306785 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 30 00:56:24.306785 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.306785 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f66fb4ba-c9d6-46ef-8b7a-7b0065b50f37 tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:56:24.306785 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-f66fb4ba-c9d6-46ef-8b7a-7b0065b50f37 tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.168104 Oct 30 00:56:24.306785 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 402/785] 10.222.0.36 () {60 vars in 1156 bytes} [Sun Oct 30 00:56:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 00:56:24.312448 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-35f9e116-efbf-4da7-9a58-07ff51c9194a tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] Action: 'create', calling method: .version_select at 0x7faf759bce50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1363504755", "metadata": {"Type": "work"}}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:56:24.317841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-35f9e116-efbf-4da7-9a58-07ff51c9194a tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] Request method failure captured: Oct 30 00:56:24.317841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 30 00:56:24.317841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 00:56:24.317841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 00:56:24.317841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 00:56:24.317841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 120 Oct 30 00:56:24.317841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 00:56:24.317841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 00:56:24.317841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 00:56:24.317841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 00:56:24.317841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXcu4hV6KjCK82phh6c1_ABLrJnJsaG--3_pdoyG4K9E2gbLPWH19NmmTyLoE_AjfmD34aRUvwQ6K3I87URSuYVkplPvWvz-MCwA45u0YgvJzIux0Bj-T3HR0WemgCPrtLE3NcMFPw0VjeuQB7AZk06cPhqDV5Aule7kqLqEUvb9bnK0 Oct 30 00:56:24.317841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 00:56:24.317841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 00:56:24.317841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 00:56:24.317841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 00:56:24.317841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 00:56:24.317841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 00:56:24.317841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: c9d7c91873be42cfbad24838de99e145 Oct 30 00:56:24.317841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-VolumesNegativeTest-1119018459 Oct 30 00:56:24.317841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 00:56:24.317841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 00:56:24.319512 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c9d7c91873be42cfbad24838de99e145"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c9d7c91873be42cfbad24838de99e145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c9d7c91873be42cfbad24838de99e145"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c9d7c91873be42cfbad24838de99e145"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:56:24.319512 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-VolumesNegativeTest-1119018459 Oct 30 00:56:24.319512 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: c9d7c91873be42cfbad24838de99e145 Oct 30 00:56:24.319512 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-VolumesNegativeTest-1119018459 Oct 30 00:56:24.319512 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-VolumesNegativeTest-1119018459-project Oct 30 00:56:24.319512 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 00:56:24.319512 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 00:56:24.319512 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: 884aac2daddd438b96d16553e8805fd9 Oct 30 00:56:24.319512 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-VolumesNegativeTest-1119018459-project Oct 30 00:56:24.319512 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Oct 30 00:56:24.319512 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1363504755", "metadata": {"Type": "work"}}} Oct 30 00:56:24.319512 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: Oct 30 00:56:24.319512 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 30 00:56:24.320516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1363504755', 'metadata': {'Type': 'work'}}}} Oct 30 00:56:24.320516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:56:24.320516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:24.320516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 00:56:24.320516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 00:56:24.320516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 00:56:24.320516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise error Oct 30 00:56:24.320516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 30 00:56:24.320516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.320516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 30 00:56:24.320516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 30 00:56:24.320516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.320516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 30 00:56:24.320516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi '0' Oct 30 00:56:24.320516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.320516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:24.320516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.320516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:24.320516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:56:24.320516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:56:24.320516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:56:24.320516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:56:24.322163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 00:56:24.322163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 00:56:24.322163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:56:24.322163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:56:24.322163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 00:56:24.322163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 00:56:24.322163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 00:56:24.322163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 00:56:24.322163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 00:56:24.322163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 00:56:24.322163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 30 00:56:24.322163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.322163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:24.322163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.322163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:24.322163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:56:24.322163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:56:24.322163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 00:56:24.322163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 00:56:24.323617 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 30 00:56:24.323617 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.323617 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-35f9e116-efbf-4da7-9a58-07ff51c9194a tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:56:24.323617 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-35f9e116-efbf-4da7-9a58-07ff51c9194a tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010489 Oct 30 00:56:24.323617 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 384/786] 10.222.0.36 () {60 vars in 1156 bytes} [Sun Oct 30 00:56:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 00:56:24.327982 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7234d958-5dcb-469d-b1c6-76ef19243660 tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] Action: 'create', calling method: .version_select at 0x7faf757c8c10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1169213088", "metadata": {"Type": "work"}}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:56:24.331936 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7234d958-5dcb-469d-b1c6-76ef19243660 tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] Request method failure captured: Oct 30 00:56:24.331936 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 30 00:56:24.331936 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 00:56:24.331936 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 00:56:24.331936 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 00:56:24.331936 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 119 Oct 30 00:56:24.331936 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 00:56:24.331936 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 00:56:24.331936 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 00:56:24.331936 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 00:56:24.331936 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcu4hV6KjCK82phh6c1_ABLrJnJsaG--3_pdoyG4K9E2gbLPWH19NmmTyLoE_AjfmD34aRUvwQ6K3I87URSuYVkplPvWvz-MCwA45u0YgvJzIux0Bj-T3HR0WemgCPrtLE3NcMFPw0VjeuQB7AZk06cPhqDV5Aule7kqLqEUvb9bnK0 Oct 30 00:56:24.331936 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 00:56:24.331936 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 00:56:24.331936 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 00:56:24.331936 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 00:56:24.331936 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 00:56:24.331936 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 00:56:24.331936 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: c9d7c91873be42cfbad24838de99e145 Oct 30 00:56:24.331936 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-VolumesNegativeTest-1119018459 Oct 30 00:56:24.331936 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 00:56:24.331936 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 00:56:24.333532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c9d7c91873be42cfbad24838de99e145"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c9d7c91873be42cfbad24838de99e145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c9d7c91873be42cfbad24838de99e145"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c9d7c91873be42cfbad24838de99e145"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:56:24.333532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-VolumesNegativeTest-1119018459 Oct 30 00:56:24.333532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: c9d7c91873be42cfbad24838de99e145 Oct 30 00:56:24.333532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-VolumesNegativeTest-1119018459 Oct 30 00:56:24.333532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-VolumesNegativeTest-1119018459-project Oct 30 00:56:24.333532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 00:56:24.333532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 00:56:24.333532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 884aac2daddd438b96d16553e8805fd9 Oct 30 00:56:24.333532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-VolumesNegativeTest-1119018459-project Oct 30 00:56:24.333532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Oct 30 00:56:24.333532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1169213088", "metadata": {"Type": "work"}}} Oct 30 00:56:24.333532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: Oct 30 00:56:24.333532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 30 00:56:24.334453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1169213088', 'metadata': {'Type': 'work'}}}} Oct 30 00:56:24.334453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:56:24.334453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:24.334453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 30 00:56:24.334453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 30 00:56:24.334453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 30 00:56:24.334453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise error Oct 30 00:56:24.334453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 30 00:56:24.334453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.334453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 30 00:56:24.334453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 30 00:56:24.334453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.334453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 30 00:56:24.334453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi '' Oct 30 00:56:24.334453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.334453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:24.334453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.334453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:24.334453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:56:24.334453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:56:24.334453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:56:24.334453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:56:24.336204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 00:56:24.336204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 00:56:24.336204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:56:24.336204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:56:24.336204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 30 00:56:24.336204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 30 00:56:24.336204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 30 00:56:24.336204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 30 00:56:24.336204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 30 00:56:24.336204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 30 00:56:24.336204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 30 00:56:24.336204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.336204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:24.336204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.336204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:24.336204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:56:24.336204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:56:24.336204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 30 00:56:24.336204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 30 00:56:24.337424 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 30 00:56:24.337424 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.337424 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7234d958-5dcb-469d-b1c6-76ef19243660 tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:56:24.337424 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7234d958-5dcb-469d-b1c6-76ef19243660 tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009125 Oct 30 00:56:24.337424 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 403/787] 10.222.0.36 () {60 vars in 1156 bytes} [Sun Oct 30 00:56:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 00:56:24.342514 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5e34c91e-056b-455b-b1e8-e1b86ec41aa3 tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] Calling method '.version_select at 0x7faf75a0daf0>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:24.371421 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-5e34c91e-056b-455b-b1e8-e1b86ec41aa3 tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] HTTP exception thrown: Volume tempest-invalid-675115784 could not be found. Oct 30 00:56:24.373538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5e34c91e-056b-455b-b1e8-e1b86ec41aa3 tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] Request method failure captured: Oct 30 00:56:24.373538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-675115784 HTTP/1.1 Oct 30 00:56:24.373538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 00:56:24.373538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 00:56:24.373538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 00:56:24.373538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 00:56:24.373538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 00:56:24.373538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 00:56:24.373538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 00:56:24.373538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 00:56:24.373538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXcu4hV6KjCK82phh6c1_ABLrJnJsaG--3_pdoyG4K9E2gbLPWH19NmmTyLoE_AjfmD34aRUvwQ6K3I87URSuYVkplPvWvz-MCwA45u0YgvJzIux0Bj-T3HR0WemgCPrtLE3NcMFPw0VjeuQB7AZk06cPhqDV5Aule7kqLqEUvb9bnK0 Oct 30 00:56:24.373538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 00:56:24.373538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 00:56:24.373538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 00:56:24.373538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 00:56:24.373538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 00:56:24.373538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 00:56:24.373538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: c9d7c91873be42cfbad24838de99e145 Oct 30 00:56:24.373538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-VolumesNegativeTest-1119018459 Oct 30 00:56:24.373538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 00:56:24.373538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 00:56:24.375037 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c9d7c91873be42cfbad24838de99e145"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c9d7c91873be42cfbad24838de99e145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c9d7c91873be42cfbad24838de99e145"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c9d7c91873be42cfbad24838de99e145"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:56:24.375037 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-VolumesNegativeTest-1119018459 Oct 30 00:56:24.375037 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: c9d7c91873be42cfbad24838de99e145 Oct 30 00:56:24.375037 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-VolumesNegativeTest-1119018459 Oct 30 00:56:24.375037 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-VolumesNegativeTest-1119018459-project Oct 30 00:56:24.375037 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 00:56:24.375037 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 00:56:24.375037 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: 884aac2daddd438b96d16553e8805fd9 Oct 30 00:56:24.375037 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-VolumesNegativeTest-1119018459-project Oct 30 00:56:24.375037 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: Oct 30 00:56:24.375037 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Volume tempest-invalid-675115784 could not be found. Oct 30 00:56:24.375037 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': 'tempest-invalid-675115784'} Oct 30 00:56:24.375037 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:56:24.375924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:24.375924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 00:56:24.375924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 00:56:24.375924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 30 00:56:24.375924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 30 00:56:24.375924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 30 00:56:24.375924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 30 00:56:24.375924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 30 00:56:24.375924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 30 00:56:24.375924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 30 00:56:24.375924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 30 00:56:24.375924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 00:56:24.375924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 00:56:24.375924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 00:56:24.375924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 00:56:24.375924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-675115784 could not be found. (HTTP 404) (Request-ID: req-3cdd3bf6-b3b3-4aa8-b2ad-8d845015dec7) Oct 30 00:56:24.375924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.375924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:24.375924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.377291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:24.377291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 30 00:56:24.377291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 30 00:56:24.377291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 00:56:24.377291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 00:56:24.377291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 00:56:24.377291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 00:56:24.377291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 00:56:24.377291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 00:56:24.377291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 00:56:24.377291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 00:56:24.377291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 30 00:56:24.377291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 30 00:56:24.377291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 30 00:56:24.377291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 30 00:56:24.377291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 30 00:56:24.377291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 30 00:56:24.377291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 30 00:56:24.377291 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 30 00:56:24.379677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 00:56:24.379677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 00:56:24.379677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 00:56:24.379677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 00:56:24.379677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-675115784 could not be found. Oct 30 00:56:24.379677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.379677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:24.379677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.379677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:24.379677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:56:24.379677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:56:24.379677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:56:24.379677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:56:24.379677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 00:56:24.379677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 00:56:24.379677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:56:24.379677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:56:24.379677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 30 00:56:24.379677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:56:24.379677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-675115784 could not be found. Oct 30 00:56:24.381004 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.381004 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:24.381004 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.381004 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:24.381004 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:56:24.381004 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:56:24.381004 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:56:24.381004 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:56:24.381004 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-675115784 could not be found. Oct 30 00:56:24.381004 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.381004 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5e34c91e-056b-455b-b1e8-e1b86ec41aa3 tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] Returning 404 to user: Volume tempest-invalid-675115784 could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:56:24.381004 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5e34c91e-056b-455b-b1e8-e1b86ec41aa3 tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-675115784" status: 404 len: 98 microversion: 2.1 time: 0.036613 Oct 30 00:56:24.381004 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 385/788] 10.222.0.36 () {58 vars in 1215 bytes} [Sun Oct 30 00:56:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-675115784 => generated 98 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 30 00:56:24.386617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-3d0898b6-b57f-4f37-808d-829d81b4579f tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003660 Oct 30 00:56:24.387125 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 404/789] 10.222.0.36 () {58 vars in 1140 bytes} [Sun Oct 30 00:56:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 30 00:56:24.395301 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-b4fa58fd-24ed-491d-b09f-8164e425dd11 tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003888 Oct 30 00:56:24.395855 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 386/790] 10.222.0.36 () {58 vars in 1137 bytes} [Sun Oct 30 00:56:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 30 00:56:24.403635 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-1cceb8eb-5a49-47c9-92f6-7dd481c90de3 tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] Calling method '.version_select at 0x7faf79312d30>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:24.432269 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-1cceb8eb-5a49-47c9-92f6-7dd481c90de3 tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] HTTP exception thrown: Volume 89de867e-32cf-4bfd-9ecf-c8fc4ca6b896 could not be found. Oct 30 00:56:24.435514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-1cceb8eb-5a49-47c9-92f6-7dd481c90de3 tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] Request method failure captured: Oct 30 00:56:24.435514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: DELETE /compute/v2.1/os-volumes/89de867e-32cf-4bfd-9ecf-c8fc4ca6b896 HTTP/1.1 Oct 30 00:56:24.435514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 00:56:24.435514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 00:56:24.435514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 00:56:24.435514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 00:56:24.435514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 00:56:24.435514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 00:56:24.435514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 00:56:24.435514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 00:56:24.435514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcu4hV6KjCK82phh6c1_ABLrJnJsaG--3_pdoyG4K9E2gbLPWH19NmmTyLoE_AjfmD34aRUvwQ6K3I87URSuYVkplPvWvz-MCwA45u0YgvJzIux0Bj-T3HR0WemgCPrtLE3NcMFPw0VjeuQB7AZk06cPhqDV5Aule7kqLqEUvb9bnK0 Oct 30 00:56:24.435514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 00:56:24.435514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 00:56:24.435514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 00:56:24.435514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 00:56:24.435514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 00:56:24.435514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 00:56:24.435514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: c9d7c91873be42cfbad24838de99e145 Oct 30 00:56:24.435514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-VolumesNegativeTest-1119018459 Oct 30 00:56:24.435514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 00:56:24.435514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 00:56:24.437068 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c9d7c91873be42cfbad24838de99e145"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c9d7c91873be42cfbad24838de99e145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c9d7c91873be42cfbad24838de99e145"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c9d7c91873be42cfbad24838de99e145"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:56:24.437068 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-VolumesNegativeTest-1119018459 Oct 30 00:56:24.437068 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: c9d7c91873be42cfbad24838de99e145 Oct 30 00:56:24.437068 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-VolumesNegativeTest-1119018459 Oct 30 00:56:24.437068 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-VolumesNegativeTest-1119018459-project Oct 30 00:56:24.437068 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 00:56:24.437068 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 00:56:24.437068 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 884aac2daddd438b96d16553e8805fd9 Oct 30 00:56:24.437068 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-VolumesNegativeTest-1119018459-project Oct 30 00:56:24.437068 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: Oct 30 00:56:24.437068 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Volume 89de867e-32cf-4bfd-9ecf-c8fc4ca6b896 could not be found. Oct 30 00:56:24.437068 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': '89de867e-32cf-4bfd-9ecf-c8fc4ca6b896'} Oct 30 00:56:24.437068 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:56:24.438043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:24.438043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 00:56:24.438043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 00:56:24.438043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 30 00:56:24.438043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 30 00:56:24.438043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 30 00:56:24.438043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 30 00:56:24.438043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 30 00:56:24.438043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 30 00:56:24.438043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 30 00:56:24.438043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 30 00:56:24.438043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 00:56:24.438043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 00:56:24.438043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 00:56:24.438043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 00:56:24.438043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 89de867e-32cf-4bfd-9ecf-c8fc4ca6b896 could not be found. (HTTP 404) (Request-ID: req-78c2fcd0-7c17-4875-a135-ee078d273c90) Oct 30 00:56:24.438043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.438043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:24.438043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.439496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:24.439496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 30 00:56:24.439496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 30 00:56:24.439496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 00:56:24.439496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 00:56:24.439496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 00:56:24.439496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 00:56:24.439496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 00:56:24.439496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 00:56:24.439496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 00:56:24.439496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 00:56:24.439496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 30 00:56:24.439496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 30 00:56:24.439496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 30 00:56:24.439496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 30 00:56:24.439496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 30 00:56:24.439496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 30 00:56:24.439496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 30 00:56:24.439496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 30 00:56:24.441540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 00:56:24.441540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 00:56:24.441540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 00:56:24.441540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 00:56:24.441540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 89de867e-32cf-4bfd-9ecf-c8fc4ca6b896 could not be found. Oct 30 00:56:24.441540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.441540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:24.441540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.441540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:24.441540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:56:24.441540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:56:24.441540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:56:24.441540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:56:24.441540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 00:56:24.441540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 00:56:24.441540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:56:24.441540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:56:24.441540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 30 00:56:24.441540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:56:24.442996 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 89de867e-32cf-4bfd-9ecf-c8fc4ca6b896 could not be found. Oct 30 00:56:24.442996 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.442996 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:24.442996 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.442996 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:24.442996 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:56:24.442996 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:56:24.442996 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:56:24.442996 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:56:24.442996 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 89de867e-32cf-4bfd-9ecf-c8fc4ca6b896 could not be found. Oct 30 00:56:24.442996 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.442996 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-1cceb8eb-5a49-47c9-92f6-7dd481c90de3 tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] Returning 404 to user: Volume 89de867e-32cf-4bfd-9ecf-c8fc4ca6b896 could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:56:24.442996 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-1cceb8eb-5a49-47c9-92f6-7dd481c90de3 tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/89de867e-32cf-4bfd-9ecf-c8fc4ca6b896" status: 404 len: 109 microversion: 2.1 time: 0.036791 Oct 30 00:56:24.442996 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 405/791] 10.222.0.36 () {58 vars in 1248 bytes} [Sun Oct 30 00:56:24 2022] DELETE /compute/v2.1/os-volumes/89de867e-32cf-4bfd-9ecf-c8fc4ca6b896 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 00:56:24.447349 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-fde3a191-15cc-44dd-a036-c1933290ccba tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] Calling method '.version_select at 0x7faf75b34dc0>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:24.475030 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-fde3a191-15cc-44dd-a036-c1933290ccba tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] HTTP exception thrown: Volume e83ef96a-467a-446e-92f9-e6eac0e86070 could not be found. Oct 30 00:56:24.476984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-fde3a191-15cc-44dd-a036-c1933290ccba tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] Request method failure captured: Oct 30 00:56:24.476984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: GET /compute/v2.1/os-volumes/e83ef96a-467a-446e-92f9-e6eac0e86070 HTTP/1.1 Oct 30 00:56:24.476984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 00:56:24.476984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 00:56:24.476984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 00:56:24.476984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 00:56:24.476984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 00:56:24.476984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 00:56:24.476984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 00:56:24.476984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 00:56:24.476984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXcu4hV6KjCK82phh6c1_ABLrJnJsaG--3_pdoyG4K9E2gbLPWH19NmmTyLoE_AjfmD34aRUvwQ6K3I87URSuYVkplPvWvz-MCwA45u0YgvJzIux0Bj-T3HR0WemgCPrtLE3NcMFPw0VjeuQB7AZk06cPhqDV5Aule7kqLqEUvb9bnK0 Oct 30 00:56:24.476984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 00:56:24.476984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 00:56:24.476984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 00:56:24.476984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 00:56:24.476984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 00:56:24.476984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 00:56:24.476984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: c9d7c91873be42cfbad24838de99e145 Oct 30 00:56:24.476984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-VolumesNegativeTest-1119018459 Oct 30 00:56:24.476984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 00:56:24.476984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 00:56:24.478506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c9d7c91873be42cfbad24838de99e145"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c9d7c91873be42cfbad24838de99e145"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c9d7c91873be42cfbad24838de99e145"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c9d7c91873be42cfbad24838de99e145"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:56:24.478506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-VolumesNegativeTest-1119018459 Oct 30 00:56:24.478506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: c9d7c91873be42cfbad24838de99e145 Oct 30 00:56:24.478506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-VolumesNegativeTest-1119018459 Oct 30 00:56:24.478506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-VolumesNegativeTest-1119018459-project Oct 30 00:56:24.478506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 00:56:24.478506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 00:56:24.478506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: 884aac2daddd438b96d16553e8805fd9 Oct 30 00:56:24.478506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-VolumesNegativeTest-1119018459-project Oct 30 00:56:24.478506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: Oct 30 00:56:24.478506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Volume e83ef96a-467a-446e-92f9-e6eac0e86070 could not be found. Oct 30 00:56:24.478506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': 'e83ef96a-467a-446e-92f9-e6eac0e86070'} Oct 30 00:56:24.478506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:56:24.479452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:24.479452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 00:56:24.479452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 00:56:24.479452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 00:56:24.479452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 00:56:24.479452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 00:56:24.479452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 00:56:24.479452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 00:56:24.479452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 00:56:24.479452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 00:56:24.479452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 00:56:24.479452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 00:56:24.479452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 00:56:24.479452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 00:56:24.479452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 00:56:24.479452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e83ef96a-467a-446e-92f9-e6eac0e86070 could not be found. (HTTP 404) (Request-ID: req-d4a8732f-3221-4598-8ad6-e8b67f077438) Oct 30 00:56:24.479452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.479452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:24.479452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.480850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:24.480850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 30 00:56:24.480850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 30 00:56:24.480850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 00:56:24.480850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 00:56:24.480850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 00:56:24.480850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 00:56:24.480850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 00:56:24.480850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 00:56:24.480850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 00:56:24.480850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 00:56:24.480850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 00:56:24.480850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 00:56:24.480850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 00:56:24.480850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 00:56:24.480850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 00:56:24.480850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 00:56:24.480850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 00:56:24.480850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 00:56:24.482044 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 00:56:24.482044 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 00:56:24.482044 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 00:56:24.482044 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 00:56:24.482044 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e83ef96a-467a-446e-92f9-e6eac0e86070 could not be found. Oct 30 00:56:24.482044 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.482044 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:24.482044 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.482044 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:24.482044 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:56:24.482044 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:56:24.482044 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:56:24.482044 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:56:24.482044 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 00:56:24.482044 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 00:56:24.482044 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:56:24.482044 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:56:24.482044 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 30 00:56:24.482044 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:56:24.483319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e83ef96a-467a-446e-92f9-e6eac0e86070 could not be found. Oct 30 00:56:24.483319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.483319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:24.483319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.483319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:24.483319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:56:24.483319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:56:24.483319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:56:24.483319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:56:24.483319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e83ef96a-467a-446e-92f9-e6eac0e86070 could not be found. Oct 30 00:56:24.483319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:56:24.483319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-fde3a191-15cc-44dd-a036-c1933290ccba tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] Returning 404 to user: Volume e83ef96a-467a-446e-92f9-e6eac0e86070 could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:56:24.483319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-fde3a191-15cc-44dd-a036-c1933290ccba tempest-VolumesNegativeTest-1119018459 tempest-VolumesNegativeTest-1119018459-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/e83ef96a-467a-446e-92f9-e6eac0e86070" status: 404 len: 109 microversion: 2.1 time: 0.034978 Oct 30 00:56:24.483319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 387/792] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Oct 30 00:56:24 2022] GET /compute/v2.1/os-volumes/e83ef96a-467a-446e-92f9-e6eac0e86070 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 00:56:33.517340 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:33.518083 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:33.522993 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2471e605-ad3e-43ec-ad29-c018f194891d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:33.525824 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2471e605-ad3e-43ec-ad29-c018f194891d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:33.533852 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2471e605-ad3e-43ec-ad29-c018f194891d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:33.535365 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2471e605-ad3e-43ec-ad29-c018f194891d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:33.535906 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2471e605-ad3e-43ec-ad29-c018f194891d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:33.536626 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2471e605-ad3e-43ec-ad29-c018f194891d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:33.537071 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2471e605-ad3e-43ec-ad29-c018f194891d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:33.537485 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2471e605-ad3e-43ec-ad29-c018f194891d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:33.567497 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2471e605-ad3e-43ec-ad29-c018f194891d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051486 Oct 30 00:56:33.568030 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 406/793] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Oct 30 00:56:33 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 00:56:33.630151 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:33.630894 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:33.634651 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3807a605-a24a-4a9a-880c-3518d5901781 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:33.635140 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-3807a605-a24a-4a9a-880c-3518d5901781 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:33.642800 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3807a605-a24a-4a9a-880c-3518d5901781 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:33.643281 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3807a605-a24a-4a9a-880c-3518d5901781 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:33.644307 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3807a605-a24a-4a9a-880c-3518d5901781 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:33.645023 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3807a605-a24a-4a9a-880c-3518d5901781 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:33.645467 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3807a605-a24a-4a9a-880c-3518d5901781 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:33.645887 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3807a605-a24a-4a9a-880c-3518d5901781 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:33.671593 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-3807a605-a24a-4a9a-880c-3518d5901781 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Going to try to terminate instance {{(pid=125553) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 00:56:33.748758 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-3807a605-a24a-4a9a-880c-3518d5901781 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 204 len: 0 microversion: 2.1 time: 0.120830 Oct 30 00:56:33.749548 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 388/794] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 00:56:33 2022] DELETE /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 00:56:33.759462 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c479147e-d6bf-4434-8b08-4f23799514a2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:33.760344 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c479147e-d6bf-4434-8b08-4f23799514a2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:33.766617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c479147e-d6bf-4434-8b08-4f23799514a2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:33.767088 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c479147e-d6bf-4434-8b08-4f23799514a2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:33.767513 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c479147e-d6bf-4434-8b08-4f23799514a2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:33.768250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c479147e-d6bf-4434-8b08-4f23799514a2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:33.768745 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c479147e-d6bf-4434-8b08-4f23799514a2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:33.769788 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c479147e-d6bf-4434-8b08-4f23799514a2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:33.900914 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c479147e-d6bf-4434-8b08-4f23799514a2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:33.908977 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c479147e-d6bf-4434-8b08-4f23799514a2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1673 microversion: 2.1 time: 0.153444 Oct 30 00:56:33.909602 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 407/795] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:33 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:34.934174 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-bcb311df-14cd-47b5-92eb-1f0d105268c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:34.934799 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-bcb311df-14cd-47b5-92eb-1f0d105268c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:34.941151 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bcb311df-14cd-47b5-92eb-1f0d105268c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:34.941667 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bcb311df-14cd-47b5-92eb-1f0d105268c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:34.942109 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bcb311df-14cd-47b5-92eb-1f0d105268c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:34.942894 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bcb311df-14cd-47b5-92eb-1f0d105268c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:34.943350 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bcb311df-14cd-47b5-92eb-1f0d105268c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:34.943774 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bcb311df-14cd-47b5-92eb-1f0d105268c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:35.084225 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-bcb311df-14cd-47b5-92eb-1f0d105268c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:35.092178 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-bcb311df-14cd-47b5-92eb-1f0d105268c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1673 microversion: 2.1 time: 0.162275 Oct 30 00:56:35.092777 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 389/796] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:34 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:36.015945 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-c4fbf677-2e29-4b70-b0fa-e9df6e0702b1 req-4c629131-620a-4efd-a7ea-49d9a3e1b765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4250f845-2f85-48d9-bf11-5b7093520b26", "name": "network-vif-deleted", "tag": "bc753166-f353-4e52-8984-d2a862e879f6"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:56:36.027532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-c4fbf677-2e29-4b70-b0fa-e9df6e0702b1 req-4c629131-620a-4efd-a7ea-49d9a3e1b765 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:36.028122 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-c4fbf677-2e29-4b70-b0fa-e9df6e0702b1 req-4c629131-620a-4efd-a7ea-49d9a3e1b765 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:36.029198 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-c4fbf677-2e29-4b70-b0fa-e9df6e0702b1 req-4c629131-620a-4efd-a7ea-49d9a3e1b765 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:36.040929 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-c4fbf677-2e29-4b70-b0fa-e9df6e0702b1 req-4c629131-620a-4efd-a7ea-49d9a3e1b765 service nova] Creating event network-vif-deleted:bc753166-f353-4e52-8984-d2a862e879f6 for instance 4250f845-2f85-48d9-bf11-5b7093520b26 on hv-cinder-86149 Oct 30 00:56:36.046653 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-c4fbf677-2e29-4b70-b0fa-e9df6e0702b1 req-4c629131-620a-4efd-a7ea-49d9a3e1b765 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034185 Oct 30 00:56:36.047423 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 408/797] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:56:36.118599 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-762e0d7c-0821-4c54-b35d-bc720ce39e44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:36.119806 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-762e0d7c-0821-4c54-b35d-bc720ce39e44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:36.126314 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-762e0d7c-0821-4c54-b35d-bc720ce39e44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:36.127042 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-762e0d7c-0821-4c54-b35d-bc720ce39e44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:36.127654 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-762e0d7c-0821-4c54-b35d-bc720ce39e44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:36.128866 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-762e0d7c-0821-4c54-b35d-bc720ce39e44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:36.130237 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-762e0d7c-0821-4c54-b35d-bc720ce39e44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:36.134723 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-762e0d7c-0821-4c54-b35d-bc720ce39e44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:36.171121 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-762e0d7c-0821-4c54-b35d-bc720ce39e44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:36.171954 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-762e0d7c-0821-4c54-b35d-bc720ce39e44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:36.172613 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-762e0d7c-0821-4c54-b35d-bc720ce39e44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:36.173232 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.objects.instance [None req-762e0d7c-0821-4c54-b35d-bc720ce39e44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lazy-loading 'fault' on Instance uuid 4250f845-2f85-48d9-bf11-5b7093520b26 {{(pid=125553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:56:36.221499 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-762e0d7c-0821-4c54-b35d-bc720ce39e44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:36.236174 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-762e0d7c-0821-4c54-b35d-bc720ce39e44 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 200 len: 1327 microversion: 2.1 time: 0.120774 Oct 30 00:56:36.237117 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 390/798] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:36 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 1327 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:37.261485 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ba8b4a1c-db98-49b8-a5e6-af963e6bab48 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:37.262182 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ba8b4a1c-db98-49b8-a5e6-af963e6bab48 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:37.268295 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ba8b4a1c-db98-49b8-a5e6-af963e6bab48 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:37.268778 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ba8b4a1c-db98-49b8-a5e6-af963e6bab48 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:37.269220 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ba8b4a1c-db98-49b8-a5e6-af963e6bab48 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:37.270566 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ba8b4a1c-db98-49b8-a5e6-af963e6bab48 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:37.271189 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ba8b4a1c-db98-49b8-a5e6-af963e6bab48 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:37.271617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ba8b4a1c-db98-49b8-a5e6-af963e6bab48 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:37.284697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-ba8b4a1c-db98-49b8-a5e6-af963e6bab48 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] HTTP exception thrown: Instance 4250f845-2f85-48d9-bf11-5b7093520b26 could not be found. Oct 30 00:56:37.286736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ba8b4a1c-db98-49b8-a5e6-af963e6bab48 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Request method failure captured: Oct 30 00:56:37.286736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 HTTP/1.1 Oct 30 00:56:37.286736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 00:56:37.286736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 00:56:37.286736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 00:56:37.286736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 00:56:37.286736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 00:56:37.286736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 00:56:37.286736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 00:56:37.286736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 00:56:37.286736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcncSCX4qCQkCbcXRF8C3GwJzgcHekPX9qdL8L6lp7kW4TRY-vYdvmpT4Pu512PpLQ1yiOhFdX0mkBm6TJhIfYQt7Qmaq8c1P_rGyNDdA6A-vokS378YTc5598sJi2oiTlZPaNF8-lOqerJotyoXjiAxsr9X9razgtO4kuuLnqzLJ48 Oct 30 00:56:37.286736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 00:56:37.286736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 00:56:37.286736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 00:56:37.286736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 00:56:37.286736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 00:56:37.286736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 00:56:37.286736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: bb5d551adcf64bb8aea88a6c142cea5e Oct 30 00:56:37.286736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-AttachVolumeTestJSON-354791381 Oct 30 00:56:37.286736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 00:56:37.286736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 00:56:37.288393 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:56:37.288393 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-AttachVolumeTestJSON-354791381 Oct 30 00:56:37.288393 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: bb5d551adcf64bb8aea88a6c142cea5e Oct 30 00:56:37.288393 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-AttachVolumeTestJSON-354791381 Oct 30 00:56:37.288393 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-AttachVolumeTestJSON-354791381-project Oct 30 00:56:37.288393 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 00:56:37.288393 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 00:56:37.288393 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 5ac3fdb86ac24fa493706f84e1aa40a8 Oct 30 00:56:37.288393 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-AttachVolumeTestJSON-354791381-project Oct 30 00:56:37.288393 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 00:56:37.288393 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Instance 4250f845-2f85-48d9-bf11-5b7093520b26 could not be found. Oct 30 00:56:37.288393 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': '4250f845-2f85-48d9-bf11-5b7093520b26'} Oct 30 00:56:37.289509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:56:37.289509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:37.289509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:56:37.289509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:56:37.289509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:56:37.289509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:56:37.289509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:56:37.289509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:56:37.289509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:56:37.289509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:56:37.289509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4250f845-2f85-48d9-bf11-5b7093520b26 could not be found. Oct 30 00:56:37.289509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:37.289509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:37.289509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:37.289509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:37.289509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:56:37.289509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:56:37.289509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:56:37.289509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:56:37.289509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:56:37.291117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:56:37.291117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 00:56:37.291117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 00:56:37.291117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:56:37.291117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:56:37.291117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:56:37.291117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:56:37.291117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4250f845-2f85-48d9-bf11-5b7093520b26 could not be found. Oct 30 00:56:37.291117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:37.291117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:56:37.291117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:37.291117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:56:37.291117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:56:37.291117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:56:37.291117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:56:37.291117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:56:37.291117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4250f845-2f85-48d9-bf11-5b7093520b26 could not be found. Oct 30 00:56:37.291117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:56:37.292607 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ba8b4a1c-db98-49b8-a5e6-af963e6bab48 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Returning 404 to user: Instance 4250f845-2f85-48d9-bf11-5b7093520b26 could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:56:37.292607 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ba8b4a1c-db98-49b8-a5e6-af963e6bab48 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 404 len: 111 microversion: 2.1 time: 0.031270 Oct 30 00:56:37.292607 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 409/799] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:37 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 00:56:37.296881 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-97e8e6ef-deb7-40a8-9fe6-ba33d642ffd3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '.version_select at 0x7faf75adf550>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:37.315046 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-97e8e6ef-deb7-40a8-9fe6-ba33d642ffd3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-139374969" status: 202 len: 0 microversion: 2.1 time: 0.021883 Oct 30 00:56:37.315598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 391/800] 10.222.0.36 () {58 vars in 1218 bytes} [Sun Oct 30 00:56:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-139374969 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 00:56:37.948876 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-a8630da6-f466-49bf-a9da-1945805f8874 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Action: 'create', calling method: .version_select at 0x7faf7578c940>, body: {"keypair": {"name": "tempest-keypair-727878017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5MZoAqWgcOQlt0MlJUZtYEoRxtbL9bMB+k/o6KrmCzcV0qTGaMesh7Ny++1xC+EW9ieOvWNa1TWtS50aQq7IuWdwHUz+ScgMpJRtgiT9laRRPa8VJ4Y0gT9h85f71NeA=="}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:56:37.965944 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-a8630da6-f466-49bf-a9da-1945805f8874 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Getting quotas for project bb5d551adcf64bb8aea88a6c142cea5e. Resources: {'key_pairs'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 00:56:37.970045 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-a8630da6-f466-49bf-a9da-1945805f8874 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Getting quotas for user 5ac3fdb86ac24fa493706f84e1aa40a8 and project bb5d551adcf64bb8aea88a6c142cea5e. Resources: {'key_pairs'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 00:56:37.995582 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-a8630da6-f466-49bf-a9da-1945805f8874 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050502 Oct 30 00:56:38.002155 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 410/801] 10.222.0.36 () {60 vars in 1159 bytes} [Sun Oct 30 00:56:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:56:39.732912 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3cbdd973-ebad-4289-918f-c4898e605a5a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1788315872", "imageRef": "27983dee-4bd6-4aad-9c28-22bd5382709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "916e17cb-b08e-4b0c-b5e7-c44a5f632210"}], "security_groups": [{"name": "tempest-securitygroup--877206244"}], "key_name": "tempest-keypair-727878017", "user_data": "}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:56:39.842572 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.network.neutron [None req-3cbdd973-ebad-4289-918f-c4898e605a5a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] validate_networks() for [('916e17cb-b08e-4b0c-b5e7-c44a5f632210', None, None, None, None, None)] {{(pid=125553) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 00:56:40.241150 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-3cbdd973-ebad-4289-918f-c4898e605a5a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Flavor limits 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 00:56:40.241575 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-3cbdd973-ebad-4289-918f-c4898e605a5a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Image limits 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 00:56:40.242052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-3cbdd973-ebad-4289-918f-c4898e605a5a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Flavor pref 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 00:56:40.242462 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-3cbdd973-ebad-4289-918f-c4898e605a5a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Image pref 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 00:56:40.243021 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-3cbdd973-ebad-4289-918f-c4898e605a5a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 00:56:40.251826 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3cbdd973-ebad-4289-918f-c4898e605a5a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:40.252356 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3cbdd973-ebad-4289-918f-c4898e605a5a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:40.252781 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3cbdd973-ebad-4289-918f-c4898e605a5a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:40.253542 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3cbdd973-ebad-4289-918f-c4898e605a5a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:40.254022 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3cbdd973-ebad-4289-918f-c4898e605a5a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:40.255052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3cbdd973-ebad-4289-918f-c4898e605a5a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:40.272418 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-3cbdd973-ebad-4289-918f-c4898e605a5a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Getting quotas for project bb5d551adcf64bb8aea88a6c142cea5e. Resources: {'instances', 'cores', 'ram'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 00:56:40.277006 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-3cbdd973-ebad-4289-918f-c4898e605a5a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Getting quotas for user 5ac3fdb86ac24fa493706f84e1aa40a8 and project bb5d551adcf64bb8aea88a6c142cea5e. Resources: {'instances', 'cores', 'ram'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 00:56:40.289875 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-3cbdd973-ebad-4289-918f-c4898e605a5a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Going to run 1 instances... {{(pid=125553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 00:56:40.292219 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-3cbdd973-ebad-4289-918f-c4898e605a5a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27983dee-4bd6-4aad-9c28-22bd5382709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 00:56:40.345498 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-3cbdd973-ebad-4289-918f-c4898e605a5a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.617262 Oct 30 00:56:40.352774 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 392/802] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Oct 30 00:56:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 00:56:40.358028 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-8836f969-a8c0-44f2-8d65-88207bf4562f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:40.358631 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-8836f969-a8c0-44f2-8d65-88207bf4562f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:40.419273 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-8836f969-a8c0-44f2-8d65-88207bf4562f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:40.426810 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-8836f969-a8c0-44f2-8d65-88207bf4562f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 200 len: 1237 microversion: 2.1 time: 0.071875 Oct 30 00:56:40.427367 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 411/803] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:40 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:41.449544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-2e2ed212-6277-4c53-88a7-1b4fada1992e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:41.450156 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-2e2ed212-6277-4c53-88a7-1b4fada1992e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:41.503984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-2e2ed212-6277-4c53-88a7-1b4fada1992e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:41.511484 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-2e2ed212-6277-4c53-88a7-1b4fada1992e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 200 len: 1237 microversion: 2.1 time: 0.065820 Oct 30 00:56:41.512037 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 393/804] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:41 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:42.540006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f05cba1e-071f-4a43-bfa0-603f2b71246f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:42.543200 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-f05cba1e-071f-4a43-bfa0-603f2b71246f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:42.598943 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-f05cba1e-071f-4a43-bfa0-603f2b71246f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:42.606225 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-f05cba1e-071f-4a43-bfa0-603f2b71246f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 200 len: 1237 microversion: 2.1 time: 0.075743 Oct 30 00:56:42.607263 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 412/805] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:42 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 1237 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:43.629585 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a650a742-1e8a-4fe6-a236-a76bfb27cf9b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:43.630166 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a650a742-1e8a-4fe6-a236-a76bfb27cf9b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:43.689615 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a650a742-1e8a-4fe6-a236-a76bfb27cf9b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:43.697323 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a650a742-1e8a-4fe6-a236-a76bfb27cf9b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 200 len: 1237 microversion: 2.1 time: 0.071464 Oct 30 00:56:43.698275 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 394/806] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:43 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:44.721836 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-30e6b453-376a-48d7-a1c8-32a85d420454 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:44.722545 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-30e6b453-376a-48d7-a1c8-32a85d420454 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:44.730051 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30e6b453-376a-48d7-a1c8-32a85d420454 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:44.730532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30e6b453-376a-48d7-a1c8-32a85d420454 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:44.730969 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30e6b453-376a-48d7-a1c8-32a85d420454 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:44.731656 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30e6b453-376a-48d7-a1c8-32a85d420454 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:44.732128 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30e6b453-376a-48d7-a1c8-32a85d420454 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:44.732552 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30e6b453-376a-48d7-a1c8-32a85d420454 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:44.798450 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-30e6b453-376a-48d7-a1c8-32a85d420454 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:44.807471 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-30e6b453-376a-48d7-a1c8-32a85d420454 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 200 len: 1241 microversion: 2.1 time: 0.089406 Oct 30 00:56:44.807932 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 413/807] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:44 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:45.830370 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a70fc1e4-7fb0-48d4-9246-c75e1a19b60d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:45.831625 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a70fc1e4-7fb0-48d4-9246-c75e1a19b60d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:45.839214 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a70fc1e4-7fb0-48d4-9246-c75e1a19b60d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:45.839708 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a70fc1e4-7fb0-48d4-9246-c75e1a19b60d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:45.840188 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a70fc1e4-7fb0-48d4-9246-c75e1a19b60d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:45.840895 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a70fc1e4-7fb0-48d4-9246-c75e1a19b60d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:45.841353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a70fc1e4-7fb0-48d4-9246-c75e1a19b60d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:45.841781 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a70fc1e4-7fb0-48d4-9246-c75e1a19b60d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:45.912277 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a70fc1e4-7fb0-48d4-9246-c75e1a19b60d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:45.921360 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a70fc1e4-7fb0-48d4-9246-c75e1a19b60d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 200 len: 1295 microversion: 2.1 time: 0.094639 Oct 30 00:56:45.921948 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 395/808] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:45 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 1295 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:56:46.947180 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b5dabb37-b7ab-490a-8b20-379f8d1e4e0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:46.949474 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-b5dabb37-b7ab-490a-8b20-379f8d1e4e0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:46.958252 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5dabb37-b7ab-490a-8b20-379f8d1e4e0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:46.958739 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5dabb37-b7ab-490a-8b20-379f8d1e4e0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:46.959364 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5dabb37-b7ab-490a-8b20-379f8d1e4e0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:46.961579 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5dabb37-b7ab-490a-8b20-379f8d1e4e0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:46.962247 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5dabb37-b7ab-490a-8b20-379f8d1e4e0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:46.962878 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b5dabb37-b7ab-490a-8b20-379f8d1e4e0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:47.114068 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b5dabb37-b7ab-490a-8b20-379f8d1e4e0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:47.122100 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b5dabb37-b7ab-490a-8b20-379f8d1e4e0b tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 200 len: 1362 microversion: 2.1 time: 0.179893 Oct 30 00:56:47.122672 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 414/809] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:46 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:47.240887 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-a25759a3-735d-4422-a0d6-107554a9fbf7 req-c7e37f66-5fdd-44ab-be26-440fe5f066e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee562908-833e-4e3b-9a81-a997b182d64f", "tag": "28b8bae2-57d2-4a52-9ea0-362137ed5701"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:56:47.253964 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-a25759a3-735d-4422-a0d6-107554a9fbf7 req-c7e37f66-5fdd-44ab-be26-440fe5f066e8 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:47.254663 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-a25759a3-735d-4422-a0d6-107554a9fbf7 req-c7e37f66-5fdd-44ab-be26-440fe5f066e8 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:47.255199 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-a25759a3-735d-4422-a0d6-107554a9fbf7 req-c7e37f66-5fdd-44ab-be26-440fe5f066e8 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:47.268712 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-a25759a3-735d-4422-a0d6-107554a9fbf7 req-c7e37f66-5fdd-44ab-be26-440fe5f066e8 service nova] Creating event network-changed:28b8bae2-57d2-4a52-9ea0-362137ed5701 for instance ee562908-833e-4e3b-9a81-a997b182d64f on hv-cinder-86149 Oct 30 00:56:47.285521 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-a25759a3-735d-4422-a0d6-107554a9fbf7 req-c7e37f66-5fdd-44ab-be26-440fe5f066e8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049133 Oct 30 00:56:47.286165 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 396/810] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:56:48.144676 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-56b14215-e2e0-4c93-b518-6f0e04b5fd8f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:48.145389 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-56b14215-e2e0-4c93-b518-6f0e04b5fd8f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:48.153009 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-56b14215-e2e0-4c93-b518-6f0e04b5fd8f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:48.153750 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-56b14215-e2e0-4c93-b518-6f0e04b5fd8f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:48.154251 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-56b14215-e2e0-4c93-b518-6f0e04b5fd8f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:48.155013 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-56b14215-e2e0-4c93-b518-6f0e04b5fd8f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:48.155563 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-56b14215-e2e0-4c93-b518-6f0e04b5fd8f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:48.156017 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-56b14215-e2e0-4c93-b518-6f0e04b5fd8f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:48.292474 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-56b14215-e2e0-4c93-b518-6f0e04b5fd8f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:48.299971 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-56b14215-e2e0-4c93-b518-6f0e04b5fd8f tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 200 len: 1362 microversion: 2.1 time: 0.159157 Oct 30 00:56:48.300562 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 415/811] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:48 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:49.323666 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a886e5c4-0d96-4974-817f-e9d02bad35bd tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:49.324464 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a886e5c4-0d96-4974-817f-e9d02bad35bd tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:49.331363 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a886e5c4-0d96-4974-817f-e9d02bad35bd tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:49.331913 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a886e5c4-0d96-4974-817f-e9d02bad35bd tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:49.332670 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a886e5c4-0d96-4974-817f-e9d02bad35bd tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:49.333428 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a886e5c4-0d96-4974-817f-e9d02bad35bd tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:49.333943 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a886e5c4-0d96-4974-817f-e9d02bad35bd tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:49.334459 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a886e5c4-0d96-4974-817f-e9d02bad35bd tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:49.481492 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a886e5c4-0d96-4974-817f-e9d02bad35bd tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:49.489573 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a886e5c4-0d96-4974-817f-e9d02bad35bd tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 200 len: 1362 microversion: 2.1 time: 0.170537 Oct 30 00:56:49.490124 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 397/812] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:49 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:50.513786 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-5480bf26-bbd9-4aa5-84c0-31daf9081976 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:50.514331 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-5480bf26-bbd9-4aa5-84c0-31daf9081976 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:50.521084 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5480bf26-bbd9-4aa5-84c0-31daf9081976 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:50.521586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5480bf26-bbd9-4aa5-84c0-31daf9081976 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:50.522006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5480bf26-bbd9-4aa5-84c0-31daf9081976 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:50.523398 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5480bf26-bbd9-4aa5-84c0-31daf9081976 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:50.524299 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5480bf26-bbd9-4aa5-84c0-31daf9081976 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:50.524718 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5480bf26-bbd9-4aa5-84c0-31daf9081976 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:50.659086 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-5480bf26-bbd9-4aa5-84c0-31daf9081976 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:50.667402 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-5480bf26-bbd9-4aa5-84c0-31daf9081976 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 200 len: 1362 microversion: 2.1 time: 0.157553 Oct 30 00:56:50.667958 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 416/813] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:50 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:51.689712 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-32e6bfc3-46d8-4781-8435-234564d593e3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:51.690319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-32e6bfc3-46d8-4781-8435-234564d593e3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:51.692251 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=2 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:51.698876 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-32e6bfc3-46d8-4781-8435-234564d593e3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:51.699351 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-32e6bfc3-46d8-4781-8435-234564d593e3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:51.699778 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-32e6bfc3-46d8-4781-8435-234564d593e3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:51.700501 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-32e6bfc3-46d8-4781-8435-234564d593e3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:51.700950 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-32e6bfc3-46d8-4781-8435-234564d593e3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:51.701370 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-32e6bfc3-46d8-4781-8435-234564d593e3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:51.831763 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-32e6bfc3-46d8-4781-8435-234564d593e3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:51.839819 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-32e6bfc3-46d8-4781-8435-234564d593e3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 200 len: 1362 microversion: 2.1 time: 0.153912 Oct 30 00:56:51.840400 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 398/814] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:51 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:52.862749 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-cb69f227-c9b2-46b8-b966-837f7567d203 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:52.863469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-cb69f227-c9b2-46b8-b966-837f7567d203 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:52.865957 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=8 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:52.872683 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cb69f227-c9b2-46b8-b966-837f7567d203 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:52.873165 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cb69f227-c9b2-46b8-b966-837f7567d203 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:52.873921 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cb69f227-c9b2-46b8-b966-837f7567d203 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:52.874783 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cb69f227-c9b2-46b8-b966-837f7567d203 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:52.876033 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cb69f227-c9b2-46b8-b966-837f7567d203 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:52.876475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cb69f227-c9b2-46b8-b966-837f7567d203 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:53.016751 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-cb69f227-c9b2-46b8-b966-837f7567d203 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:53.025382 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-cb69f227-c9b2-46b8-b966-837f7567d203 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 200 len: 1362 microversion: 2.1 time: 0.166512 Oct 30 00:56:53.026039 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 417/815] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:52 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:54.049212 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-bc0d9247-936b-40f5-bcdd-d88e3a2d64a7 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:54.049924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-bc0d9247-936b-40f5-bcdd-d88e3a2d64a7 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:54.052512 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=10 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:56:54.059145 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bc0d9247-936b-40f5-bcdd-d88e3a2d64a7 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:54.059638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bc0d9247-936b-40f5-bcdd-d88e3a2d64a7 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:54.060553 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bc0d9247-936b-40f5-bcdd-d88e3a2d64a7 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:54.061439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bc0d9247-936b-40f5-bcdd-d88e3a2d64a7 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:54.061901 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bc0d9247-936b-40f5-bcdd-d88e3a2d64a7 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:54.062324 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bc0d9247-936b-40f5-bcdd-d88e3a2d64a7 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:54.111548 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-8a7c9ba4-a788-41b4-9e85-2b76b52d6a55 req-fea94d7c-d60b-4894-8711-dcb0609f0a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee562908-833e-4e3b-9a81-a997b182d64f", "name": "network-vif-plugged", "status": "completed", "tag": "28b8bae2-57d2-4a52-9ea0-362137ed5701"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:56:54.129870 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-8a7c9ba4-a788-41b4-9e85-2b76b52d6a55 req-fea94d7c-d60b-4894-8711-dcb0609f0a6b service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:54.130354 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-8a7c9ba4-a788-41b4-9e85-2b76b52d6a55 req-fea94d7c-d60b-4894-8711-dcb0609f0a6b service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:54.130771 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-8a7c9ba4-a788-41b4-9e85-2b76b52d6a55 req-fea94d7c-d60b-4894-8711-dcb0609f0a6b service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:54.145205 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-8a7c9ba4-a788-41b4-9e85-2b76b52d6a55 req-fea94d7c-d60b-4894-8711-dcb0609f0a6b service nova] Creating event network-vif-plugged:28b8bae2-57d2-4a52-9ea0-362137ed5701 for instance ee562908-833e-4e3b-9a81-a997b182d64f on hv-cinder-86149 Oct 30 00:56:54.153079 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-8a7c9ba4-a788-41b4-9e85-2b76b52d6a55 req-fea94d7c-d60b-4894-8711-dcb0609f0a6b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045632 Oct 30 00:56:54.154028 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 418/816] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 00:56:54.227518 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-bc0d9247-936b-40f5-bcdd-d88e3a2d64a7 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:54.237808 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-bc0d9247-936b-40f5-bcdd-d88e3a2d64a7 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 200 len: 1362 microversion: 2.1 time: 0.192117 Oct 30 00:56:54.239973 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 399/817] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:54 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:55.263218 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-e41293c3-7351-4b39-a3a2-371be381cba3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:55.263919 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-e41293c3-7351-4b39-a3a2-371be381cba3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:55.270791 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e41293c3-7351-4b39-a3a2-371be381cba3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:55.271272 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e41293c3-7351-4b39-a3a2-371be381cba3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:55.271707 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e41293c3-7351-4b39-a3a2-371be381cba3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:55.273310 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e41293c3-7351-4b39-a3a2-371be381cba3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:55.273833 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e41293c3-7351-4b39-a3a2-371be381cba3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:55.274170 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e41293c3-7351-4b39-a3a2-371be381cba3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:55.406986 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e41293c3-7351-4b39-a3a2-371be381cba3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:55.415179 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-e41293c3-7351-4b39-a3a2-371be381cba3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 200 len: 1362 microversion: 2.1 time: 0.156190 Oct 30 00:56:55.415800 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 419/818] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:55 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:56.438203 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f5950562-34fc-40ef-8c57-1117619797b5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:56.438806 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f5950562-34fc-40ef-8c57-1117619797b5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:56.445407 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f5950562-34fc-40ef-8c57-1117619797b5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:56.446032 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f5950562-34fc-40ef-8c57-1117619797b5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:56.446494 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f5950562-34fc-40ef-8c57-1117619797b5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:56.447219 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f5950562-34fc-40ef-8c57-1117619797b5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:56.447643 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f5950562-34fc-40ef-8c57-1117619797b5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:56.448066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f5950562-34fc-40ef-8c57-1117619797b5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:56.581697 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f5950562-34fc-40ef-8c57-1117619797b5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:56:56.590208 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f5950562-34fc-40ef-8c57-1117619797b5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 200 len: 1547 microversion: 2.1 time: 0.155898 Oct 30 00:56:56.590763 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 400/819] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:56:56 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:56:56.612920 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d3e54469-27b2-4770-add0-781e344f10e1 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:56:56.613454 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-d3e54469-27b2-4770-add0-781e344f10e1 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:56:56.619803 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d3e54469-27b2-4770-add0-781e344f10e1 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:56.620318 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d3e54469-27b2-4770-add0-781e344f10e1 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:56.620750 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d3e54469-27b2-4770-add0-781e344f10e1 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:56.621434 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d3e54469-27b2-4770-add0-781e344f10e1 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:56.621884 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d3e54469-27b2-4770-add0-781e344f10e1 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:56.622300 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d3e54469-27b2-4770-add0-781e344f10e1 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:56.698515 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-d3e54469-27b2-4770-add0-781e344f10e1 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089379 Oct 30 00:56:56.699100 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 420/820] 10.222.0.36 () {58 vars in 1275 bytes} [Sun Oct 30 00:56:56 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:56:57.639068 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-1959dd9b-b1b6-4a5e-a32b-8496857fb113 req-b17e701e-7cce-4bfe-9b67-709784a53b2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee562908-833e-4e3b-9a81-a997b182d64f", "tag": "28b8bae2-57d2-4a52-9ea0-362137ed5701"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:56:57.649946 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-1959dd9b-b1b6-4a5e-a32b-8496857fb113 req-b17e701e-7cce-4bfe-9b67-709784a53b2f service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:56:57.650530 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-1959dd9b-b1b6-4a5e-a32b-8496857fb113 req-b17e701e-7cce-4bfe-9b67-709784a53b2f service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:56:57.651031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-1959dd9b-b1b6-4a5e-a32b-8496857fb113 req-b17e701e-7cce-4bfe-9b67-709784a53b2f service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:56:57.664997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-1959dd9b-b1b6-4a5e-a32b-8496857fb113 req-b17e701e-7cce-4bfe-9b67-709784a53b2f service nova] Creating event network-changed:28b8bae2-57d2-4a52-9ea0-362137ed5701 for instance ee562908-833e-4e3b-9a81-a997b182d64f on hv-cinder-86149 Oct 30 00:56:57.670410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-1959dd9b-b1b6-4a5e-a32b-8496857fb113 req-b17e701e-7cce-4bfe-9b67-709784a53b2f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034923 Oct 30 00:56:57.671709 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 401/821] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:57:05.766305 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f5ad9c15-e086-4bc6-bf7b-a6d132d079cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:05.766903 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-f5ad9c15-e086-4bc6-bf7b-a6d132d079cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:05.769096 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:05.774167 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f5ad9c15-e086-4bc6-bf7b-a6d132d079cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:05.774635 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f5ad9c15-e086-4bc6-bf7b-a6d132d079cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:05.775063 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f5ad9c15-e086-4bc6-bf7b-a6d132d079cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:05.775743 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f5ad9c15-e086-4bc6-bf7b-a6d132d079cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:05.776212 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f5ad9c15-e086-4bc6-bf7b-a6d132d079cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:05.776626 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f5ad9c15-e086-4bc6-bf7b-a6d132d079cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:05.779602 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=59 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:05.802749 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-f5ad9c15-e086-4bc6-bf7b-a6d132d079cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3/ips" status: 200 len: 152 microversion: 2.20 time: 0.041642 Oct 30 00:57:05.803314 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 421/822] 10.222.0.36 () {60 vars in 1289 bytes} [Sun Oct 30 00:57:05 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:57:07.568636 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-7ab36a15-d55c-435e-b06e-7105c94b9a0c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:57:07.569414 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-7ab36a15-d55c-435e-b06e-7105c94b9a0c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:07.571692 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:07.576917 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7ab36a15-d55c-435e-b06e-7105c94b9a0c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:07.577400 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7ab36a15-d55c-435e-b06e-7105c94b9a0c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:07.577837 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7ab36a15-d55c-435e-b06e-7105c94b9a0c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:07.579037 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7ab36a15-d55c-435e-b06e-7105c94b9a0c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:07.579493 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7ab36a15-d55c-435e-b06e-7105c94b9a0c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:07.579919 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7ab36a15-d55c-435e-b06e-7105c94b9a0c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:07.583108 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:07.615692 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.objects.instance [None req-7ab36a15-d55c-435e-b06e-7105c94b9a0c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lazy-loading 'flavor' on Instance uuid f745c72f-1429-408f-bbf6-9d254529e9b3 {{(pid=125553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:57:07.812072 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-7ab36a15-d55c-435e-b06e-7105c94b9a0c tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "POST /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3/action" status: 202 len: 0 microversion: 2.20 time: 0.248962 Oct 30 00:57:07.813155 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 402/823] 10.222.0.36 () {62 vars in 1319 bytes} [Sun Oct 30 00:57:07 2022] POST /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 30 00:57:07.821618 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-0575865a-830a-4e29-a8b4-0b85008b7ef1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:07.822199 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-0575865a-830a-4e29-a8b4-0b85008b7ef1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:07.828546 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0575865a-830a-4e29-a8b4-0b85008b7ef1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:07.829369 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0575865a-830a-4e29-a8b4-0b85008b7ef1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:07.829671 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0575865a-830a-4e29-a8b4-0b85008b7ef1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:07.830358 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0575865a-830a-4e29-a8b4-0b85008b7ef1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:07.830803 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0575865a-830a-4e29-a8b4-0b85008b7ef1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:07.831215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0575865a-830a-4e29-a8b4-0b85008b7ef1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:07.976349 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-0575865a-830a-4e29-a8b4-0b85008b7ef1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:07.985010 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-0575865a-830a-4e29-a8b4-0b85008b7ef1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:07.986434 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-0575865a-830a-4e29-a8b4-0b85008b7ef1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:07.987587 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-0575865a-830a-4e29-a8b4-0b85008b7ef1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1722 microversion: 2.20 time: 0.170568 Oct 30 00:57:07.988159 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 422/824] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:07 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:09.014851 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-14ebee6c-ec00-4689-9045-b35fb07646df tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:09.015569 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-14ebee6c-ec00-4689-9045-b35fb07646df tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:09.022055 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-14ebee6c-ec00-4689-9045-b35fb07646df tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:09.022535 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-14ebee6c-ec00-4689-9045-b35fb07646df tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:09.022970 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-14ebee6c-ec00-4689-9045-b35fb07646df tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:09.023695 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-14ebee6c-ec00-4689-9045-b35fb07646df tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:09.024589 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-14ebee6c-ec00-4689-9045-b35fb07646df tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:09.024820 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-14ebee6c-ec00-4689-9045-b35fb07646df tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:09.156050 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-14ebee6c-ec00-4689-9045-b35fb07646df tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:09.164050 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-14ebee6c-ec00-4689-9045-b35fb07646df tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:09.166217 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-14ebee6c-ec00-4689-9045-b35fb07646df tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:09.167371 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-14ebee6c-ec00-4689-9045-b35fb07646df tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1722 microversion: 2.20 time: 0.157274 Oct 30 00:57:09.167920 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 403/825] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:09 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:10.192621 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7d595c85-756f-4874-a4a9-30ce44874522 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:10.193237 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-7d595c85-756f-4874-a4a9-30ce44874522 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:10.200801 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7d595c85-756f-4874-a4a9-30ce44874522 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:10.201288 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7d595c85-756f-4874-a4a9-30ce44874522 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:10.201724 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7d595c85-756f-4874-a4a9-30ce44874522 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:10.202416 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7d595c85-756f-4874-a4a9-30ce44874522 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:10.202869 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7d595c85-756f-4874-a4a9-30ce44874522 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:10.203298 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7d595c85-756f-4874-a4a9-30ce44874522 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:10.333646 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7d595c85-756f-4874-a4a9-30ce44874522 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:10.342574 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7d595c85-756f-4874-a4a9-30ce44874522 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:10.343989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7d595c85-756f-4874-a4a9-30ce44874522 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:10.345157 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7d595c85-756f-4874-a4a9-30ce44874522 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1722 microversion: 2.20 time: 0.156469 Oct 30 00:57:10.345707 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 423/826] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:10 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:11.371111 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-ac692015-4cdb-4c67-8809-ea215591e878 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:11.371710 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-ac692015-4cdb-4c67-8809-ea215591e878 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:11.378057 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ac692015-4cdb-4c67-8809-ea215591e878 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:11.378531 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ac692015-4cdb-4c67-8809-ea215591e878 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:11.378958 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ac692015-4cdb-4c67-8809-ea215591e878 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:11.379640 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ac692015-4cdb-4c67-8809-ea215591e878 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:11.380100 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ac692015-4cdb-4c67-8809-ea215591e878 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:11.380525 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ac692015-4cdb-4c67-8809-ea215591e878 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:11.507144 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ac692015-4cdb-4c67-8809-ea215591e878 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:11.515868 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ac692015-4cdb-4c67-8809-ea215591e878 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:11.517341 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ac692015-4cdb-4c67-8809-ea215591e878 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:11.518504 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-ac692015-4cdb-4c67-8809-ea215591e878 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1722 microversion: 2.20 time: 0.151817 Oct 30 00:57:11.519062 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 404/827] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:11 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:12.545651 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f90d4424-9ae9-49ad-9790-741452022da8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:12.546249 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-f90d4424-9ae9-49ad-9790-741452022da8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:12.552146 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f90d4424-9ae9-49ad-9790-741452022da8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:12.552614 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f90d4424-9ae9-49ad-9790-741452022da8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:12.553040 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f90d4424-9ae9-49ad-9790-741452022da8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:12.553716 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f90d4424-9ae9-49ad-9790-741452022da8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:12.554162 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f90d4424-9ae9-49ad-9790-741452022da8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:12.554590 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f90d4424-9ae9-49ad-9790-741452022da8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:12.684269 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-f90d4424-9ae9-49ad-9790-741452022da8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:12.692145 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-f90d4424-9ae9-49ad-9790-741452022da8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:12.693551 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-f90d4424-9ae9-49ad-9790-741452022da8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:12.694676 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-f90d4424-9ae9-49ad-9790-741452022da8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1722 microversion: 2.20 time: 0.153034 Oct 30 00:57:12.695221 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 424/828] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:12 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:13.720921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d3cbf395-bb55-4d82-8a44-af959cb865d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:13.721458 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d3cbf395-bb55-4d82-8a44-af959cb865d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:13.727830 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d3cbf395-bb55-4d82-8a44-af959cb865d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:13.728350 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d3cbf395-bb55-4d82-8a44-af959cb865d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:13.728784 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d3cbf395-bb55-4d82-8a44-af959cb865d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:13.729483 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d3cbf395-bb55-4d82-8a44-af959cb865d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:13.729919 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d3cbf395-bb55-4d82-8a44-af959cb865d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:13.730340 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d3cbf395-bb55-4d82-8a44-af959cb865d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:13.857433 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d3cbf395-bb55-4d82-8a44-af959cb865d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:13.865547 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d3cbf395-bb55-4d82-8a44-af959cb865d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:13.867089 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d3cbf395-bb55-4d82-8a44-af959cb865d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:13.868876 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d3cbf395-bb55-4d82-8a44-af959cb865d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1722 microversion: 2.20 time: 0.151916 Oct 30 00:57:13.869446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 405/829] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:13 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:14.895161 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-130080a2-6420-493d-a1ff-d5dfd26c1fe8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:14.895761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-130080a2-6420-493d-a1ff-d5dfd26c1fe8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:14.903102 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-130080a2-6420-493d-a1ff-d5dfd26c1fe8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:14.903618 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-130080a2-6420-493d-a1ff-d5dfd26c1fe8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:14.904051 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-130080a2-6420-493d-a1ff-d5dfd26c1fe8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:14.904793 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-130080a2-6420-493d-a1ff-d5dfd26c1fe8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:14.905243 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-130080a2-6420-493d-a1ff-d5dfd26c1fe8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:14.905658 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-130080a2-6420-493d-a1ff-d5dfd26c1fe8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:15.035362 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-130080a2-6420-493d-a1ff-d5dfd26c1fe8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:15.043455 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-130080a2-6420-493d-a1ff-d5dfd26c1fe8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:15.044901 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-130080a2-6420-493d-a1ff-d5dfd26c1fe8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:15.046044 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-130080a2-6420-493d-a1ff-d5dfd26c1fe8 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1722 microversion: 2.20 time: 0.154762 Oct 30 00:57:15.046605 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 425/830] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:14 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:16.072699 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-2f7899af-594b-4c9f-bc2f-5c30b42f6d42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:16.073296 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-2f7899af-594b-4c9f-bc2f-5c30b42f6d42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:16.079757 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2f7899af-594b-4c9f-bc2f-5c30b42f6d42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:16.080306 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2f7899af-594b-4c9f-bc2f-5c30b42f6d42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:16.080738 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2f7899af-594b-4c9f-bc2f-5c30b42f6d42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:16.081448 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2f7899af-594b-4c9f-bc2f-5c30b42f6d42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:16.081881 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2f7899af-594b-4c9f-bc2f-5c30b42f6d42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:16.082297 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2f7899af-594b-4c9f-bc2f-5c30b42f6d42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:16.210024 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-2f7899af-594b-4c9f-bc2f-5c30b42f6d42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:16.218100 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-2f7899af-594b-4c9f-bc2f-5c30b42f6d42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:16.219515 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-2f7899af-594b-4c9f-bc2f-5c30b42f6d42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:16.220703 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-2f7899af-594b-4c9f-bc2f-5c30b42f6d42 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1722 microversion: 2.20 time: 0.152843 Oct 30 00:57:16.221243 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 406/831] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:16 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:17.246255 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-e3afa13e-9c0c-49f7-b32e-e147e7f62eca tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:17.247062 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-e3afa13e-9c0c-49f7-b32e-e147e7f62eca tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:17.253778 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e3afa13e-9c0c-49f7-b32e-e147e7f62eca tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:17.254258 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e3afa13e-9c0c-49f7-b32e-e147e7f62eca tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:17.254694 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e3afa13e-9c0c-49f7-b32e-e147e7f62eca tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:17.255384 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e3afa13e-9c0c-49f7-b32e-e147e7f62eca tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:17.255862 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e3afa13e-9c0c-49f7-b32e-e147e7f62eca tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:17.256424 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e3afa13e-9c0c-49f7-b32e-e147e7f62eca tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:17.388117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e3afa13e-9c0c-49f7-b32e-e147e7f62eca tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:17.396187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e3afa13e-9c0c-49f7-b32e-e147e7f62eca tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:17.397649 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e3afa13e-9c0c-49f7-b32e-e147e7f62eca tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:17.398795 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-e3afa13e-9c0c-49f7-b32e-e147e7f62eca tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1722 microversion: 2.20 time: 0.156665 Oct 30 00:57:17.399441 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 426/832] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:17 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:18.423758 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5951be4a-83d8-4ad0-b720-f70046c874b9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:18.424392 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5951be4a-83d8-4ad0-b720-f70046c874b9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:18.432205 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5951be4a-83d8-4ad0-b720-f70046c874b9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:18.432689 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5951be4a-83d8-4ad0-b720-f70046c874b9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:18.433118 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5951be4a-83d8-4ad0-b720-f70046c874b9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:18.433808 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5951be4a-83d8-4ad0-b720-f70046c874b9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:18.434255 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5951be4a-83d8-4ad0-b720-f70046c874b9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:18.434703 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5951be4a-83d8-4ad0-b720-f70046c874b9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:18.569009 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5951be4a-83d8-4ad0-b720-f70046c874b9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:18.578069 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5951be4a-83d8-4ad0-b720-f70046c874b9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:18.579501 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5951be4a-83d8-4ad0-b720-f70046c874b9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:18.580728 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5951be4a-83d8-4ad0-b720-f70046c874b9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1722 microversion: 2.20 time: 0.160788 Oct 30 00:57:18.581274 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 407/833] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:18 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:19.606651 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-aaf64b14-0086-4b30-91ca-4c86a11e4280 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:19.607174 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-aaf64b14-0086-4b30-91ca-4c86a11e4280 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:19.613686 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-aaf64b14-0086-4b30-91ca-4c86a11e4280 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:19.614158 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-aaf64b14-0086-4b30-91ca-4c86a11e4280 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:19.614587 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-aaf64b14-0086-4b30-91ca-4c86a11e4280 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:19.615269 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-aaf64b14-0086-4b30-91ca-4c86a11e4280 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:19.615713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-aaf64b14-0086-4b30-91ca-4c86a11e4280 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:19.616151 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-aaf64b14-0086-4b30-91ca-4c86a11e4280 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:19.742761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-aaf64b14-0086-4b30-91ca-4c86a11e4280 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:19.751381 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-aaf64b14-0086-4b30-91ca-4c86a11e4280 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:19.752834 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-aaf64b14-0086-4b30-91ca-4c86a11e4280 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:19.753972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-aaf64b14-0086-4b30-91ca-4c86a11e4280 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1743 microversion: 2.20 time: 0.151296 Oct 30 00:57:19.754521 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 427/834] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:19 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:20.780955 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a4a7e47b-edda-4cff-bc39-05dd068ef935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:20.781552 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a4a7e47b-edda-4cff-bc39-05dd068ef935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:20.787989 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a4a7e47b-edda-4cff-bc39-05dd068ef935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:20.788511 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a4a7e47b-edda-4cff-bc39-05dd068ef935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:20.788943 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a4a7e47b-edda-4cff-bc39-05dd068ef935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:20.789632 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a4a7e47b-edda-4cff-bc39-05dd068ef935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:20.790090 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a4a7e47b-edda-4cff-bc39-05dd068ef935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:20.790508 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a4a7e47b-edda-4cff-bc39-05dd068ef935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:20.923133 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a4a7e47b-edda-4cff-bc39-05dd068ef935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:20.931134 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a4a7e47b-edda-4cff-bc39-05dd068ef935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:20.933133 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a4a7e47b-edda-4cff-bc39-05dd068ef935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:20.934289 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a4a7e47b-edda-4cff-bc39-05dd068ef935 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1743 microversion: 2.20 time: 0.157256 Oct 30 00:57:20.934843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 408/835] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:20 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:21.960286 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-6d0955c8-9f26-407e-a857-45d9fe05c9d9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:21.960836 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-6d0955c8-9f26-407e-a857-45d9fe05c9d9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:21.967853 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6d0955c8-9f26-407e-a857-45d9fe05c9d9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:21.968365 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6d0955c8-9f26-407e-a857-45d9fe05c9d9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:21.968800 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6d0955c8-9f26-407e-a857-45d9fe05c9d9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:21.969480 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6d0955c8-9f26-407e-a857-45d9fe05c9d9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:21.969929 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6d0955c8-9f26-407e-a857-45d9fe05c9d9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:21.970345 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6d0955c8-9f26-407e-a857-45d9fe05c9d9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:22.098074 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6d0955c8-9f26-407e-a857-45d9fe05c9d9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:22.107294 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6d0955c8-9f26-407e-a857-45d9fe05c9d9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:22.108757 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6d0955c8-9f26-407e-a857-45d9fe05c9d9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:22.109910 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-6d0955c8-9f26-407e-a857-45d9fe05c9d9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1743 microversion: 2.20 time: 0.153863 Oct 30 00:57:22.110471 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 428/836] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:21 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:23.136699 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c711c717-a0ac-4c1f-896e-eb06d237fcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:23.137228 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-c711c717-a0ac-4c1f-896e-eb06d237fcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:23.143734 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c711c717-a0ac-4c1f-896e-eb06d237fcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:23.144258 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c711c717-a0ac-4c1f-896e-eb06d237fcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:23.144695 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c711c717-a0ac-4c1f-896e-eb06d237fcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:23.145382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c711c717-a0ac-4c1f-896e-eb06d237fcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:23.145834 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c711c717-a0ac-4c1f-896e-eb06d237fcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:23.146280 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c711c717-a0ac-4c1f-896e-eb06d237fcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:23.276683 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c711c717-a0ac-4c1f-896e-eb06d237fcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:23.284652 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c711c717-a0ac-4c1f-896e-eb06d237fcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:23.286090 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c711c717-a0ac-4c1f-896e-eb06d237fcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:23.287240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c711c717-a0ac-4c1f-896e-eb06d237fcf7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1743 microversion: 2.20 time: 0.155077 Oct 30 00:57:23.287803 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 409/837] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:23 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:24.208639 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-3d4d2074-cef7-4b1a-8ffe-9815a2672ad5 req-9571db0d-777a-43e2-9c11-7cd5d53a6a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f745c72f-1429-408f-bbf6-9d254529e9b3", "name": "network-vif-plugged", "status": "completed", "tag": "d3536290-43b6-4818-9024-5c42427edf8f"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:57:24.220347 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-3d4d2074-cef7-4b1a-8ffe-9815a2672ad5 req-9571db0d-777a-43e2-9c11-7cd5d53a6a3a service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:24.220829 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-3d4d2074-cef7-4b1a-8ffe-9815a2672ad5 req-9571db0d-777a-43e2-9c11-7cd5d53a6a3a service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:24.221260 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-3d4d2074-cef7-4b1a-8ffe-9815a2672ad5 req-9571db0d-777a-43e2-9c11-7cd5d53a6a3a service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:24.235095 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-3d4d2074-cef7-4b1a-8ffe-9815a2672ad5 req-9571db0d-777a-43e2-9c11-7cd5d53a6a3a service nova] Creating event network-vif-plugged:d3536290-43b6-4818-9024-5c42427edf8f for instance f745c72f-1429-408f-bbf6-9d254529e9b3 on hv-cinder-86149 Oct 30 00:57:24.240279 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-3d4d2074-cef7-4b1a-8ffe-9815a2672ad5 req-9571db0d-777a-43e2-9c11-7cd5d53a6a3a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035336 Oct 30 00:57:24.240945 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 429/838] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:57:24.312950 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d5df4dc3-529d-4cf6-9117-40f79b122bd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:24.313553 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d5df4dc3-529d-4cf6-9117-40f79b122bd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:24.319946 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d5df4dc3-529d-4cf6-9117-40f79b122bd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:24.320456 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d5df4dc3-529d-4cf6-9117-40f79b122bd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:24.320884 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d5df4dc3-529d-4cf6-9117-40f79b122bd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:24.321559 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d5df4dc3-529d-4cf6-9117-40f79b122bd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:24.322010 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d5df4dc3-529d-4cf6-9117-40f79b122bd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:24.322609 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d5df4dc3-529d-4cf6-9117-40f79b122bd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:24.448991 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d5df4dc3-529d-4cf6-9117-40f79b122bd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:24.456884 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d5df4dc3-529d-4cf6-9117-40f79b122bd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:24.458313 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d5df4dc3-529d-4cf6-9117-40f79b122bd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:24.459699 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d5df4dc3-529d-4cf6-9117-40f79b122bd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1743 microversion: 2.20 time: 0.150391 Oct 30 00:57:24.460293 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 410/839] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:24 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:25.486949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4d576a92-bf6d-43f5-985f-fc7c61aa7367 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:25.487746 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-4d576a92-bf6d-43f5-985f-fc7c61aa7367 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:25.494190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4d576a92-bf6d-43f5-985f-fc7c61aa7367 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:25.495637 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4d576a92-bf6d-43f5-985f-fc7c61aa7367 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:25.495637 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4d576a92-bf6d-43f5-985f-fc7c61aa7367 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:25.496491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4d576a92-bf6d-43f5-985f-fc7c61aa7367 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:25.496783 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4d576a92-bf6d-43f5-985f-fc7c61aa7367 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:25.497298 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4d576a92-bf6d-43f5-985f-fc7c61aa7367 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:25.629119 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4d576a92-bf6d-43f5-985f-fc7c61aa7367 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:25.637902 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4d576a92-bf6d-43f5-985f-fc7c61aa7367 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:25.639347 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4d576a92-bf6d-43f5-985f-fc7c61aa7367 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:25.640634 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-4d576a92-bf6d-43f5-985f-fc7c61aa7367 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1738 microversion: 2.20 time: 0.158442 Oct 30 00:57:25.641187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 430/840] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:25 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:26.667047 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-0516dfaf-3610-4204-ae54-80616e485bec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:26.667765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-0516dfaf-3610-4204-ae54-80616e485bec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:26.676170 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0516dfaf-3610-4204-ae54-80616e485bec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:26.676663 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0516dfaf-3610-4204-ae54-80616e485bec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:26.677100 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0516dfaf-3610-4204-ae54-80616e485bec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:26.677835 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0516dfaf-3610-4204-ae54-80616e485bec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:26.678289 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0516dfaf-3610-4204-ae54-80616e485bec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:26.678713 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0516dfaf-3610-4204-ae54-80616e485bec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:26.819292 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-0516dfaf-3610-4204-ae54-80616e485bec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:26.828353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-0516dfaf-3610-4204-ae54-80616e485bec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:26.829802 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-0516dfaf-3610-4204-ae54-80616e485bec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:26.830959 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-0516dfaf-3610-4204-ae54-80616e485bec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1738 microversion: 2.20 time: 0.168465 Oct 30 00:57:26.831508 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 411/841] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:26 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:27.857641 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-63e531a5-3d42-448a-bd2a-3e2705889b04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:27.858329 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-63e531a5-3d42-448a-bd2a-3e2705889b04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:27.865152 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-63e531a5-3d42-448a-bd2a-3e2705889b04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:27.865952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-63e531a5-3d42-448a-bd2a-3e2705889b04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:27.866540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-63e531a5-3d42-448a-bd2a-3e2705889b04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:27.867318 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-63e531a5-3d42-448a-bd2a-3e2705889b04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:27.867901 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-63e531a5-3d42-448a-bd2a-3e2705889b04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:27.868364 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-63e531a5-3d42-448a-bd2a-3e2705889b04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:28.034773 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-63e531a5-3d42-448a-bd2a-3e2705889b04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:28.043770 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-63e531a5-3d42-448a-bd2a-3e2705889b04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:28.047807 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-63e531a5-3d42-448a-bd2a-3e2705889b04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:28.049157 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-63e531a5-3d42-448a-bd2a-3e2705889b04 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1738 microversion: 2.20 time: 0.196049 Oct 30 00:57:28.049795 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 431/842] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:27 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:29.078168 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-8988d48e-b150-4895-9dc1-8002a1bdc72a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:29.079416 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-8988d48e-b150-4895-9dc1-8002a1bdc72a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:29.090886 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8988d48e-b150-4895-9dc1-8002a1bdc72a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:29.091683 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8988d48e-b150-4895-9dc1-8002a1bdc72a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:29.092377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8988d48e-b150-4895-9dc1-8002a1bdc72a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:29.093275 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8988d48e-b150-4895-9dc1-8002a1bdc72a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:29.093918 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8988d48e-b150-4895-9dc1-8002a1bdc72a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:29.094527 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8988d48e-b150-4895-9dc1-8002a1bdc72a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:29.473617 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8988d48e-b150-4895-9dc1-8002a1bdc72a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:29.483924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8988d48e-b150-4895-9dc1-8002a1bdc72a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:29.487300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8988d48e-b150-4895-9dc1-8002a1bdc72a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:29.488907 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-8988d48e-b150-4895-9dc1-8002a1bdc72a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1738 microversion: 2.20 time: 0.416988 Oct 30 00:57:29.489672 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 412/843] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:29 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1738 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:30.519243 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b02608fc-e8eb-4516-ba93-f945573099c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:30.520547 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-b02608fc-e8eb-4516-ba93-f945573099c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:30.528478 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b02608fc-e8eb-4516-ba93-f945573099c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:30.530319 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b02608fc-e8eb-4516-ba93-f945573099c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:30.530757 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b02608fc-e8eb-4516-ba93-f945573099c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:30.531456 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b02608fc-e8eb-4516-ba93-f945573099c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:30.531906 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b02608fc-e8eb-4516-ba93-f945573099c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:30.532365 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b02608fc-e8eb-4516-ba93-f945573099c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:30.675814 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b02608fc-e8eb-4516-ba93-f945573099c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:30.685429 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b02608fc-e8eb-4516-ba93-f945573099c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:30.686986 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b02608fc-e8eb-4516-ba93-f945573099c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:30.688045 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b02608fc-e8eb-4516-ba93-f945573099c7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1738 microversion: 2.20 time: 0.173189 Oct 30 00:57:30.688618 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 432/844] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:30 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:57:31.718115 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-cd3871f2-6531-4c0d-8de9-727c7134d7f7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:31.719069 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-cd3871f2-6531-4c0d-8de9-727c7134d7f7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:31.741073 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd3871f2-6531-4c0d-8de9-727c7134d7f7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:31.741566 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd3871f2-6531-4c0d-8de9-727c7134d7f7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:31.742109 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd3871f2-6531-4c0d-8de9-727c7134d7f7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:31.748760 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd3871f2-6531-4c0d-8de9-727c7134d7f7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:31.749107 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd3871f2-6531-4c0d-8de9-727c7134d7f7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:31.749461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd3871f2-6531-4c0d-8de9-727c7134d7f7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:31.900322 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-cd3871f2-6531-4c0d-8de9-727c7134d7f7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:31.909218 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-cd3871f2-6531-4c0d-8de9-727c7134d7f7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:31.914227 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-cd3871f2-6531-4c0d-8de9-727c7134d7f7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:31.915501 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-cd3871f2-6531-4c0d-8de9-727c7134d7f7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1738 microversion: 2.20 time: 0.205665 Oct 30 00:57:31.916387 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 413/845] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:31 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:32.943815 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-11181290-f54f-423f-ba4a-b4163c7d60d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:32.945494 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-11181290-f54f-423f-ba4a-b4163c7d60d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:32.953695 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-11181290-f54f-423f-ba4a-b4163c7d60d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:32.954497 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-11181290-f54f-423f-ba4a-b4163c7d60d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:32.955183 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-11181290-f54f-423f-ba4a-b4163c7d60d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:32.955972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-11181290-f54f-423f-ba4a-b4163c7d60d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:32.956772 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-11181290-f54f-423f-ba4a-b4163c7d60d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:32.957776 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-11181290-f54f-423f-ba4a-b4163c7d60d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:33.117038 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-11181290-f54f-423f-ba4a-b4163c7d60d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:33.127718 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-11181290-f54f-423f-ba4a-b4163c7d60d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:33.129176 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-11181290-f54f-423f-ba4a-b4163c7d60d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:33.130625 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-11181290-f54f-423f-ba4a-b4163c7d60d0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1738 microversion: 2.20 time: 0.192105 Oct 30 00:57:33.131144 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 433/846] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:32 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:34.157557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-0cadb678-ac9a-4f55-a167-cbe71b9b6c71 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:34.158140 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-0cadb678-ac9a-4f55-a167-cbe71b9b6c71 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:34.166557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0cadb678-ac9a-4f55-a167-cbe71b9b6c71 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:34.167154 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0cadb678-ac9a-4f55-a167-cbe71b9b6c71 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:34.167611 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0cadb678-ac9a-4f55-a167-cbe71b9b6c71 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:34.168345 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0cadb678-ac9a-4f55-a167-cbe71b9b6c71 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:34.168975 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0cadb678-ac9a-4f55-a167-cbe71b9b6c71 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:34.169598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0cadb678-ac9a-4f55-a167-cbe71b9b6c71 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:34.320053 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-0cadb678-ac9a-4f55-a167-cbe71b9b6c71 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:34.332919 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-0cadb678-ac9a-4f55-a167-cbe71b9b6c71 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:34.334639 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-0cadb678-ac9a-4f55-a167-cbe71b9b6c71 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:34.336280 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-0cadb678-ac9a-4f55-a167-cbe71b9b6c71 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1738 microversion: 2.20 time: 0.183067 Oct 30 00:57:34.352506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 414/847] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:34 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:35.363979 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-83077e2d-5def-4eb0-b295-3e855db7eea9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:35.364658 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-83077e2d-5def-4eb0-b295-3e855db7eea9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:35.371496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-83077e2d-5def-4eb0-b295-3e855db7eea9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:35.372123 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-83077e2d-5def-4eb0-b295-3e855db7eea9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:35.372643 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-83077e2d-5def-4eb0-b295-3e855db7eea9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:35.373419 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-83077e2d-5def-4eb0-b295-3e855db7eea9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:35.373946 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-83077e2d-5def-4eb0-b295-3e855db7eea9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:35.374443 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-83077e2d-5def-4eb0-b295-3e855db7eea9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:35.508601 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-83077e2d-5def-4eb0-b295-3e855db7eea9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:35.517237 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-83077e2d-5def-4eb0-b295-3e855db7eea9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:35.518674 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-83077e2d-5def-4eb0-b295-3e855db7eea9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:35.519805 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-83077e2d-5def-4eb0-b295-3e855db7eea9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1738 microversion: 2.20 time: 0.159832 Oct 30 00:57:35.520393 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 434/848] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:35 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:36.545943 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-9a3dfaa7-d4fa-4bc5-b90c-d43426d93df2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:36.546571 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-9a3dfaa7-d4fa-4bc5-b90c-d43426d93df2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:36.552576 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9a3dfaa7-d4fa-4bc5-b90c-d43426d93df2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:36.553052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9a3dfaa7-d4fa-4bc5-b90c-d43426d93df2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:36.553485 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9a3dfaa7-d4fa-4bc5-b90c-d43426d93df2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:36.554177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9a3dfaa7-d4fa-4bc5-b90c-d43426d93df2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:36.554627 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9a3dfaa7-d4fa-4bc5-b90c-d43426d93df2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:36.555048 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9a3dfaa7-d4fa-4bc5-b90c-d43426d93df2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:36.687310 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-9a3dfaa7-d4fa-4bc5-b90c-d43426d93df2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:36.695894 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-9a3dfaa7-d4fa-4bc5-b90c-d43426d93df2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:36.697031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-9a3dfaa7-d4fa-4bc5-b90c-d43426d93df2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:36.699198 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-9a3dfaa7-d4fa-4bc5-b90c-d43426d93df2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1720 microversion: 2.20 time: 0.157072 Oct 30 00:57:36.708708 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 415/849] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:36 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:37.725627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-9f7b8377-c4aa-40c7-844a-6368bb260521 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:37.726249 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-9f7b8377-c4aa-40c7-844a-6368bb260521 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:37.728620 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=28 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:37.735157 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9f7b8377-c4aa-40c7-844a-6368bb260521 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:37.735631 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9f7b8377-c4aa-40c7-844a-6368bb260521 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:37.736057 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9f7b8377-c4aa-40c7-844a-6368bb260521 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:37.736757 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9f7b8377-c4aa-40c7-844a-6368bb260521 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:37.737200 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9f7b8377-c4aa-40c7-844a-6368bb260521 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:37.737623 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9f7b8377-c4aa-40c7-844a-6368bb260521 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:37.740134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=78 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:37.871290 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9f7b8377-c4aa-40c7-844a-6368bb260521 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:37.879356 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9f7b8377-c4aa-40c7-844a-6368bb260521 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:37.880805 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9f7b8377-c4aa-40c7-844a-6368bb260521 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:37.881951 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-9f7b8377-c4aa-40c7-844a-6368bb260521 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1720 microversion: 2.20 time: 0.160187 Oct 30 00:57:37.882504 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 435/850] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:37 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:38.908721 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-676c8592-4e24-4239-a76b-8224932accc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:38.909351 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-676c8592-4e24-4239-a76b-8224932accc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:38.912045 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=28 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:38.918672 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-676c8592-4e24-4239-a76b-8224932accc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:38.919157 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-676c8592-4e24-4239-a76b-8224932accc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:38.919594 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-676c8592-4e24-4239-a76b-8224932accc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:38.920324 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-676c8592-4e24-4239-a76b-8224932accc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:38.920782 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-676c8592-4e24-4239-a76b-8224932accc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:38.921207 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-676c8592-4e24-4239-a76b-8224932accc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:38.923749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:57:39.051867 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-676c8592-4e24-4239-a76b-8224932accc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:39.060359 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-676c8592-4e24-4239-a76b-8224932accc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:39.061749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-676c8592-4e24-4239-a76b-8224932accc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:39.062905 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-676c8592-4e24-4239-a76b-8224932accc6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1723 microversion: 2.20 time: 0.159430 Oct 30 00:57:39.063453 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 416/851] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:38 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:39.088293 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-842fa2a0-c471-47b6-aaa3-c1023630eef0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53ca0942-ea0a-4ef5-8e35-8af39c94816c"}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:57:39.091184 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-842fa2a0-c471-47b6-aaa3-c1023630eef0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:39.097901 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-842fa2a0-c471-47b6-aaa3-c1023630eef0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:39.098373 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-842fa2a0-c471-47b6-aaa3-c1023630eef0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:39.098829 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-842fa2a0-c471-47b6-aaa3-c1023630eef0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:39.099596 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-842fa2a0-c471-47b6-aaa3-c1023630eef0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:39.100053 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-842fa2a0-c471-47b6-aaa3-c1023630eef0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:39.100505 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-842fa2a0-c471-47b6-aaa3-c1023630eef0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:39.364425 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-842fa2a0-c471-47b6-aaa3-c1023630eef0 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "POST /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.280272 Oct 30 00:57:39.365019 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 436/852] 10.222.0.36 () {62 vars in 1364 bytes} [Sun Oct 30 00:57:39 2022] POST /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3/os-volume_attachments => generated 188 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 30 00:57:39.490694 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f178375c-8ce4-4d8b-bf62-e0e6fd0fd911 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:39.491189 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f178375c-8ce4-4d8b-bf62-e0e6fd0fd911 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:39.498179 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f178375c-8ce4-4d8b-bf62-e0e6fd0fd911 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:39.498664 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f178375c-8ce4-4d8b-bf62-e0e6fd0fd911 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:39.499106 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f178375c-8ce4-4d8b-bf62-e0e6fd0fd911 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:39.499828 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f178375c-8ce4-4d8b-bf62-e0e6fd0fd911 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:39.500335 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f178375c-8ce4-4d8b-bf62-e0e6fd0fd911 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:39.500864 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f178375c-8ce4-4d8b-bf62-e0e6fd0fd911 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:39.746004 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f178375c-8ce4-4d8b-bf62-e0e6fd0fd911 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3/os-volume_attachments/53ca0942-ea0a-4ef5-8e35-8af39c94816c" status: 202 len: 0 microversion: 2.20 time: 0.258249 Oct 30 00:57:39.746727 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 417/853] 10.222.0.36 () {60 vars in 1457 bytes} [Sun Oct 30 00:57:39 2022] DELETE /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3/os-volume_attachments/53ca0942-ea0a-4ef5-8e35-8af39c94816c => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 00:57:39.806662 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-9effbc3a-0ed5-4888-a5bd-91e4be6578c6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:57:39.807248 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-9effbc3a-0ed5-4888-a5bd-91e4be6578c6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:39.813279 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9effbc3a-0ed5-4888-a5bd-91e4be6578c6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:39.813752 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9effbc3a-0ed5-4888-a5bd-91e4be6578c6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:39.814182 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9effbc3a-0ed5-4888-a5bd-91e4be6578c6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:39.814861 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9effbc3a-0ed5-4888-a5bd-91e4be6578c6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:39.815311 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9effbc3a-0ed5-4888-a5bd-91e4be6578c6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:39.815731 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9effbc3a-0ed5-4888-a5bd-91e4be6578c6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:39.844844 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-9effbc3a-0ed5-4888-a5bd-91e4be6578c6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125554) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 30 00:57:39.911323 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-9effbc3a-0ed5-4888-a5bd-91e4be6578c6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "POST /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3/action" status: 202 len: 0 microversion: 2.20 time: 0.108551 Oct 30 00:57:39.912195 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 437/854] 10.222.0.36 () {62 vars in 1319 bytes} [Sun Oct 30 00:57:39 2022] POST /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 30 00:57:39.922674 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-dd70a0e6-2dee-4520-90ea-f177b8dd1354 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:39.924395 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-dd70a0e6-2dee-4520-90ea-f177b8dd1354 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:39.931527 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-dd70a0e6-2dee-4520-90ea-f177b8dd1354 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:39.932012 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-dd70a0e6-2dee-4520-90ea-f177b8dd1354 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:39.932674 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-dd70a0e6-2dee-4520-90ea-f177b8dd1354 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:39.933550 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-dd70a0e6-2dee-4520-90ea-f177b8dd1354 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:39.934176 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-dd70a0e6-2dee-4520-90ea-f177b8dd1354 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:39.934605 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-dd70a0e6-2dee-4520-90ea-f177b8dd1354 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:40.069125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-dd70a0e6-2dee-4520-90ea-f177b8dd1354 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:40.077565 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-dd70a0e6-2dee-4520-90ea-f177b8dd1354 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:40.079084 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-dd70a0e6-2dee-4520-90ea-f177b8dd1354 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:40.080444 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-dd70a0e6-2dee-4520-90ea-f177b8dd1354 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1671 microversion: 2.20 time: 0.164312 Oct 30 00:57:40.081074 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 418/855] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:39 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:40.312131 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-9f50b816-a6d2-4aa6-81bb-db385219f826 req-5593d921-67f8-40cd-b76c-467d15571593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f745c72f-1429-408f-bbf6-9d254529e9b3", "name": "network-vif-unplugged", "status": "completed", "tag": "d3536290-43b6-4818-9024-5c42427edf8f"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:57:40.322680 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-9f50b816-a6d2-4aa6-81bb-db385219f826 req-5593d921-67f8-40cd-b76c-467d15571593 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:40.324039 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-9f50b816-a6d2-4aa6-81bb-db385219f826 req-5593d921-67f8-40cd-b76c-467d15571593 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:40.325422 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-9f50b816-a6d2-4aa6-81bb-db385219f826 req-5593d921-67f8-40cd-b76c-467d15571593 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:40.338363 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.compute.server_external_events [req-9f50b816-a6d2-4aa6-81bb-db385219f826 req-5593d921-67f8-40cd-b76c-467d15571593 service nova] Unable to find a host for instance f745c72f-1429-408f-bbf6-9d254529e9b3. Dropping event network-vif-unplugged {{(pid=125554) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 30 00:57:40.340262 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-9f50b816-a6d2-4aa6-81bb-db385219f826 req-5593d921-67f8-40cd-b76c-467d15571593 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033205 Oct 30 00:57:40.340854 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 438/856] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 30 00:57:41.107820 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f4db8816-72de-41fb-9c35-48b1c040bb9b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:41.108447 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f4db8816-72de-41fb-9c35-48b1c040bb9b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:41.114819 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f4db8816-72de-41fb-9c35-48b1c040bb9b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:41.115300 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f4db8816-72de-41fb-9c35-48b1c040bb9b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:41.115726 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f4db8816-72de-41fb-9c35-48b1c040bb9b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:41.116462 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f4db8816-72de-41fb-9c35-48b1c040bb9b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:41.116908 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f4db8816-72de-41fb-9c35-48b1c040bb9b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:41.117326 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f4db8816-72de-41fb-9c35-48b1c040bb9b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:41.253760 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f4db8816-72de-41fb-9c35-48b1c040bb9b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:41.262512 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f4db8816-72de-41fb-9c35-48b1c040bb9b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:41.263941 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f4db8816-72de-41fb-9c35-48b1c040bb9b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:41.265121 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f4db8816-72de-41fb-9c35-48b1c040bb9b tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1673 microversion: 2.20 time: 0.162334 Oct 30 00:57:41.265667 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 419/857] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:41 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:42.291661 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-29544c60-b9c5-40ca-89a6-160f0dde6300 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:42.292827 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-29544c60-b9c5-40ca-89a6-160f0dde6300 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:42.298928 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-29544c60-b9c5-40ca-89a6-160f0dde6300 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:42.299406 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-29544c60-b9c5-40ca-89a6-160f0dde6300 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:42.299953 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-29544c60-b9c5-40ca-89a6-160f0dde6300 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:42.300553 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-29544c60-b9c5-40ca-89a6-160f0dde6300 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:42.301010 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-29544c60-b9c5-40ca-89a6-160f0dde6300 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:42.301434 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-29544c60-b9c5-40ca-89a6-160f0dde6300 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:42.441712 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-29544c60-b9c5-40ca-89a6-160f0dde6300 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:42.450319 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-29544c60-b9c5-40ca-89a6-160f0dde6300 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:42.456579 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-29544c60-b9c5-40ca-89a6-160f0dde6300 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:42.457958 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-29544c60-b9c5-40ca-89a6-160f0dde6300 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1729 microversion: 2.20 time: 0.170116 Oct 30 00:57:42.465666 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 439/858] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:42 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:43.509829 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-39e46c69-d361-4291-905d-6ae32c480791 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:43.510415 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-39e46c69-d361-4291-905d-6ae32c480791 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:43.517293 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-39e46c69-d361-4291-905d-6ae32c480791 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:43.517777 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-39e46c69-d361-4291-905d-6ae32c480791 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:43.518213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-39e46c69-d361-4291-905d-6ae32c480791 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:43.518906 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-39e46c69-d361-4291-905d-6ae32c480791 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:43.519357 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-39e46c69-d361-4291-905d-6ae32c480791 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:43.519782 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-39e46c69-d361-4291-905d-6ae32c480791 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:43.652965 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-39e46c69-d361-4291-905d-6ae32c480791 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:43.662288 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-39e46c69-d361-4291-905d-6ae32c480791 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:43.664285 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-39e46c69-d361-4291-905d-6ae32c480791 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:43.665574 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-39e46c69-d361-4291-905d-6ae32c480791 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1729 microversion: 2.20 time: 0.159778 Oct 30 00:57:43.680329 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 420/859] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:43 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:44.692637 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-df3105ab-9ed6-44d6-9b39-c7cf9701be30 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:44.693236 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-df3105ab-9ed6-44d6-9b39-c7cf9701be30 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:44.714899 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-df3105ab-9ed6-44d6-9b39-c7cf9701be30 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:44.715751 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-df3105ab-9ed6-44d6-9b39-c7cf9701be30 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:44.716448 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-df3105ab-9ed6-44d6-9b39-c7cf9701be30 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:44.717638 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-df3105ab-9ed6-44d6-9b39-c7cf9701be30 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:44.718341 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-df3105ab-9ed6-44d6-9b39-c7cf9701be30 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:44.718760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-df3105ab-9ed6-44d6-9b39-c7cf9701be30 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:44.859061 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-df3105ab-9ed6-44d6-9b39-c7cf9701be30 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:44.867452 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-df3105ab-9ed6-44d6-9b39-c7cf9701be30 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:44.868947 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-df3105ab-9ed6-44d6-9b39-c7cf9701be30 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:44.870793 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-df3105ab-9ed6-44d6-9b39-c7cf9701be30 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1729 microversion: 2.20 time: 0.181689 Oct 30 00:57:44.871476 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 440/860] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:44 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:45.896836 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-7f7b5b7e-0d44-4766-a3fa-2cc333b63734 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:45.897436 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-7f7b5b7e-0d44-4766-a3fa-2cc333b63734 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:45.905404 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7f7b5b7e-0d44-4766-a3fa-2cc333b63734 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:45.905884 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7f7b5b7e-0d44-4766-a3fa-2cc333b63734 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:45.906315 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7f7b5b7e-0d44-4766-a3fa-2cc333b63734 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:45.907009 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7f7b5b7e-0d44-4766-a3fa-2cc333b63734 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:45.907460 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7f7b5b7e-0d44-4766-a3fa-2cc333b63734 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:45.907877 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7f7b5b7e-0d44-4766-a3fa-2cc333b63734 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:46.054531 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-7f7b5b7e-0d44-4766-a3fa-2cc333b63734 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:46.062772 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-7f7b5b7e-0d44-4766-a3fa-2cc333b63734 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:46.064236 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-7f7b5b7e-0d44-4766-a3fa-2cc333b63734 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:46.065382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-7f7b5b7e-0d44-4766-a3fa-2cc333b63734 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1729 microversion: 2.20 time: 0.172451 Oct 30 00:57:46.065965 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 421/861] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:45 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:57:47.093508 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-a26b4174-fca3-456e-be4b-747c7066b681 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:47.094331 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-a26b4174-fca3-456e-be4b-747c7066b681 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:47.101273 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a26b4174-fca3-456e-be4b-747c7066b681 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:47.101818 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a26b4174-fca3-456e-be4b-747c7066b681 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:47.102309 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a26b4174-fca3-456e-be4b-747c7066b681 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:47.103061 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a26b4174-fca3-456e-be4b-747c7066b681 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:47.103555 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a26b4174-fca3-456e-be4b-747c7066b681 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:47.103981 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a26b4174-fca3-456e-be4b-747c7066b681 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:47.249392 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-a26b4174-fca3-456e-be4b-747c7066b681 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:47.257960 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-a26b4174-fca3-456e-be4b-747c7066b681 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:47.259863 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-a26b4174-fca3-456e-be4b-747c7066b681 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:47.262010 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-a26b4174-fca3-456e-be4b-747c7066b681 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1729 microversion: 2.20 time: 0.174706 Oct 30 00:57:47.263290 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 441/862] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:47 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:48.289471 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3662d4c9-04e9-497d-ade6-2ee90cd6ce19 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:48.290179 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-3662d4c9-04e9-497d-ade6-2ee90cd6ce19 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:48.297995 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3662d4c9-04e9-497d-ade6-2ee90cd6ce19 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:48.298481 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3662d4c9-04e9-497d-ade6-2ee90cd6ce19 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:48.298918 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3662d4c9-04e9-497d-ade6-2ee90cd6ce19 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:48.299616 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3662d4c9-04e9-497d-ade6-2ee90cd6ce19 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:48.300064 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3662d4c9-04e9-497d-ade6-2ee90cd6ce19 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:48.300514 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3662d4c9-04e9-497d-ade6-2ee90cd6ce19 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:48.593101 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3662d4c9-04e9-497d-ade6-2ee90cd6ce19 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:48.601349 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3662d4c9-04e9-497d-ade6-2ee90cd6ce19 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:48.602803 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3662d4c9-04e9-497d-ade6-2ee90cd6ce19 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:48.603986 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-3662d4c9-04e9-497d-ade6-2ee90cd6ce19 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1729 microversion: 2.20 time: 0.318425 Oct 30 00:57:48.605059 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 422/863] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:48 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1729 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:49.630452 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4b86eab8-98d5-4287-943f-b784e369c0e9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:49.631002 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-4b86eab8-98d5-4287-943f-b784e369c0e9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:49.638403 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4b86eab8-98d5-4287-943f-b784e369c0e9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:49.638893 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4b86eab8-98d5-4287-943f-b784e369c0e9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:49.639321 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4b86eab8-98d5-4287-943f-b784e369c0e9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:49.640017 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4b86eab8-98d5-4287-943f-b784e369c0e9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:49.640488 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4b86eab8-98d5-4287-943f-b784e369c0e9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:49.640902 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4b86eab8-98d5-4287-943f-b784e369c0e9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:49.796504 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4b86eab8-98d5-4287-943f-b784e369c0e9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:49.805881 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4b86eab8-98d5-4287-943f-b784e369c0e9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:49.807275 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4b86eab8-98d5-4287-943f-b784e369c0e9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:49.809072 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-4b86eab8-98d5-4287-943f-b784e369c0e9 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1729 microversion: 2.20 time: 0.182518 Oct 30 00:57:49.809947 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 442/864] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:49 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:50.834774 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5827791e-44f7-4cc2-811d-67d95066a716 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:50.835411 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5827791e-44f7-4cc2-811d-67d95066a716 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:50.843021 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5827791e-44f7-4cc2-811d-67d95066a716 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:50.843652 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5827791e-44f7-4cc2-811d-67d95066a716 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:50.843996 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5827791e-44f7-4cc2-811d-67d95066a716 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:50.844682 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5827791e-44f7-4cc2-811d-67d95066a716 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:50.845132 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5827791e-44f7-4cc2-811d-67d95066a716 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:50.845555 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5827791e-44f7-4cc2-811d-67d95066a716 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:50.994892 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5827791e-44f7-4cc2-811d-67d95066a716 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:51.003599 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5827791e-44f7-4cc2-811d-67d95066a716 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:51.005039 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5827791e-44f7-4cc2-811d-67d95066a716 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:51.006196 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5827791e-44f7-4cc2-811d-67d95066a716 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1729 microversion: 2.20 time: 0.175330 Oct 30 00:57:51.006806 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 423/865] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:50 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:52.031992 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-e4f46b64-67d1-42fb-bed3-100748a8e8a4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:52.032600 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-e4f46b64-67d1-42fb-bed3-100748a8e8a4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:52.038953 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e4f46b64-67d1-42fb-bed3-100748a8e8a4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:52.039431 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e4f46b64-67d1-42fb-bed3-100748a8e8a4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:52.039868 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e4f46b64-67d1-42fb-bed3-100748a8e8a4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:52.040580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e4f46b64-67d1-42fb-bed3-100748a8e8a4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:52.041031 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e4f46b64-67d1-42fb-bed3-100748a8e8a4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:52.041455 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e4f46b64-67d1-42fb-bed3-100748a8e8a4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:52.172159 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e4f46b64-67d1-42fb-bed3-100748a8e8a4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:52.180286 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e4f46b64-67d1-42fb-bed3-100748a8e8a4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:52.181721 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e4f46b64-67d1-42fb-bed3-100748a8e8a4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:52.182870 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-e4f46b64-67d1-42fb-bed3-100748a8e8a4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1729 microversion: 2.20 time: 0.155458 Oct 30 00:57:52.183424 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 443/866] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:52 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:53.210161 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-23e43489-2f7f-426e-be3a-581fa2510071 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:53.210769 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-23e43489-2f7f-426e-be3a-581fa2510071 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:53.218084 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-23e43489-2f7f-426e-be3a-581fa2510071 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:53.218568 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-23e43489-2f7f-426e-be3a-581fa2510071 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:53.219007 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-23e43489-2f7f-426e-be3a-581fa2510071 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:53.219706 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-23e43489-2f7f-426e-be3a-581fa2510071 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:53.220192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-23e43489-2f7f-426e-be3a-581fa2510071 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:53.220621 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-23e43489-2f7f-426e-be3a-581fa2510071 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:53.355221 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-23e43489-2f7f-426e-be3a-581fa2510071 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:53.363772 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-23e43489-2f7f-426e-be3a-581fa2510071 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:53.365220 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-23e43489-2f7f-426e-be3a-581fa2510071 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:53.366398 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-23e43489-2f7f-426e-be3a-581fa2510071 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1729 microversion: 2.20 time: 0.160171 Oct 30 00:57:53.366936 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 424/867] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:53 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:54.392334 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-6c606811-4150-41df-a77b-a04573174bf2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:54.392917 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-6c606811-4150-41df-a77b-a04573174bf2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:54.400073 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6c606811-4150-41df-a77b-a04573174bf2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:54.400565 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6c606811-4150-41df-a77b-a04573174bf2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:54.400992 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6c606811-4150-41df-a77b-a04573174bf2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:54.401665 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6c606811-4150-41df-a77b-a04573174bf2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:54.402108 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6c606811-4150-41df-a77b-a04573174bf2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:54.403211 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6c606811-4150-41df-a77b-a04573174bf2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:54.530888 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6c606811-4150-41df-a77b-a04573174bf2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:54.538795 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6c606811-4150-41df-a77b-a04573174bf2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:54.540228 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6c606811-4150-41df-a77b-a04573174bf2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:54.541361 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-6c606811-4150-41df-a77b-a04573174bf2 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1729 microversion: 2.20 time: 0.152975 Oct 30 00:57:54.541912 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 444/868] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:54 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:55.574995 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-969e13c8-b650-4702-8e83-d682243abdd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:55.575627 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-969e13c8-b650-4702-8e83-d682243abdd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:55.586974 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-969e13c8-b650-4702-8e83-d682243abdd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:55.587516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-969e13c8-b650-4702-8e83-d682243abdd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:55.588253 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-969e13c8-b650-4702-8e83-d682243abdd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:55.589551 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-969e13c8-b650-4702-8e83-d682243abdd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:55.591341 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-969e13c8-b650-4702-8e83-d682243abdd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:55.592172 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-969e13c8-b650-4702-8e83-d682243abdd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:55.724408 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-969e13c8-b650-4702-8e83-d682243abdd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:55.733264 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-969e13c8-b650-4702-8e83-d682243abdd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:55.734671 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-969e13c8-b650-4702-8e83-d682243abdd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:55.735811 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-969e13c8-b650-4702-8e83-d682243abdd6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1729 microversion: 2.20 time: 0.167879 Oct 30 00:57:55.736382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 425/869] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:55 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 30 00:57:56.760653 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7d7f3b1a-bc88-4bc1-bf59-83da649572e3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:56.761249 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-7d7f3b1a-bc88-4bc1-bf59-83da649572e3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:56.768242 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7d7f3b1a-bc88-4bc1-bf59-83da649572e3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:56.768718 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7d7f3b1a-bc88-4bc1-bf59-83da649572e3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:56.769145 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7d7f3b1a-bc88-4bc1-bf59-83da649572e3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:56.769822 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7d7f3b1a-bc88-4bc1-bf59-83da649572e3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:56.770263 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7d7f3b1a-bc88-4bc1-bf59-83da649572e3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:56.770678 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7d7f3b1a-bc88-4bc1-bf59-83da649572e3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:56.897198 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7d7f3b1a-bc88-4bc1-bf59-83da649572e3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:56.905585 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7d7f3b1a-bc88-4bc1-bf59-83da649572e3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:56.906994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7d7f3b1a-bc88-4bc1-bf59-83da649572e3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:56.908165 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7d7f3b1a-bc88-4bc1-bf59-83da649572e3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1729 microversion: 2.20 time: 0.151346 Oct 30 00:57:56.908712 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 445/870] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:56 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:57.933540 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-6659a2c2-5025-48f7-bd75-ea2fd29580b1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:57.934357 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-6659a2c2-5025-48f7-bd75-ea2fd29580b1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:57.940983 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6659a2c2-5025-48f7-bd75-ea2fd29580b1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:57.941463 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6659a2c2-5025-48f7-bd75-ea2fd29580b1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:57.941890 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6659a2c2-5025-48f7-bd75-ea2fd29580b1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:57.942572 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6659a2c2-5025-48f7-bd75-ea2fd29580b1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:57.943022 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6659a2c2-5025-48f7-bd75-ea2fd29580b1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:57.943436 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6659a2c2-5025-48f7-bd75-ea2fd29580b1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:58.070494 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-6659a2c2-5025-48f7-bd75-ea2fd29580b1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:58.079852 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-6659a2c2-5025-48f7-bd75-ea2fd29580b1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:58.081301 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-6659a2c2-5025-48f7-bd75-ea2fd29580b1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:58.082444 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-6659a2c2-5025-48f7-bd75-ea2fd29580b1 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1729 microversion: 2.20 time: 0.152779 Oct 30 00:57:58.083014 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 426/871] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:57 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:57:59.109219 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-5eb86bd3-156a-4c6e-9917-09e5a2d292ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:57:59.109823 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-5eb86bd3-156a-4c6e-9917-09e5a2d292ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:57:59.116222 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5eb86bd3-156a-4c6e-9917-09e5a2d292ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:59.116702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5eb86bd3-156a-4c6e-9917-09e5a2d292ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:59.117133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5eb86bd3-156a-4c6e-9917-09e5a2d292ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:59.117816 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5eb86bd3-156a-4c6e-9917-09e5a2d292ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:57:59.118266 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5eb86bd3-156a-4c6e-9917-09e5a2d292ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:57:59.118684 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5eb86bd3-156a-4c6e-9917-09e5a2d292ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:57:59.250394 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-5eb86bd3-156a-4c6e-9917-09e5a2d292ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:59.258497 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-5eb86bd3-156a-4c6e-9917-09e5a2d292ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:59.259938 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-5eb86bd3-156a-4c6e-9917-09e5a2d292ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:57:59.261117 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-5eb86bd3-156a-4c6e-9917-09e5a2d292ec tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1729 microversion: 2.20 time: 0.156706 Oct 30 00:57:59.261678 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 446/872] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:57:59 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:58:00.287861 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-49600145-5c03-4e66-98ac-fcf8b686b0cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:00.288546 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-49600145-5c03-4e66-98ac-fcf8b686b0cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:00.295369 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-49600145-5c03-4e66-98ac-fcf8b686b0cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:00.295856 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-49600145-5c03-4e66-98ac-fcf8b686b0cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:00.296428 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-49600145-5c03-4e66-98ac-fcf8b686b0cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:00.297137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-49600145-5c03-4e66-98ac-fcf8b686b0cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:00.297594 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-49600145-5c03-4e66-98ac-fcf8b686b0cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:00.298017 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-49600145-5c03-4e66-98ac-fcf8b686b0cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:00.438061 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-49600145-5c03-4e66-98ac-fcf8b686b0cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:58:00.446601 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-49600145-5c03-4e66-98ac-fcf8b686b0cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:58:00.448047 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-49600145-5c03-4e66-98ac-fcf8b686b0cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:58:00.449230 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-49600145-5c03-4e66-98ac-fcf8b686b0cb tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1729 microversion: 2.20 time: 0.165289 Oct 30 00:58:00.450862 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 427/873] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:58:00 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:58:00.556432 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-89ee1fc1-1637-484e-9b38-b0bf8d0bd08f req-56328464-a224-4915-b6fa-c4e090085718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f745c72f-1429-408f-bbf6-9d254529e9b3", "name": "network-vif-plugged", "status": "completed", "tag": "d3536290-43b6-4818-9024-5c42427edf8f"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:58:00.567141 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-89ee1fc1-1637-484e-9b38-b0bf8d0bd08f req-56328464-a224-4915-b6fa-c4e090085718 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:00.567406 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-89ee1fc1-1637-484e-9b38-b0bf8d0bd08f req-56328464-a224-4915-b6fa-c4e090085718 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:00.567830 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-89ee1fc1-1637-484e-9b38-b0bf8d0bd08f req-56328464-a224-4915-b6fa-c4e090085718 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:00.579432 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-89ee1fc1-1637-484e-9b38-b0bf8d0bd08f req-56328464-a224-4915-b6fa-c4e090085718 service nova] Creating event network-vif-plugged:d3536290-43b6-4818-9024-5c42427edf8f for instance f745c72f-1429-408f-bbf6-9d254529e9b3 on hv-cinder-86149 Oct 30 00:58:00.584443 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-89ee1fc1-1637-484e-9b38-b0bf8d0bd08f req-56328464-a224-4915-b6fa-c4e090085718 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031768 Oct 30 00:58:00.585098 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 447/874] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:58:01.476818 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-83bc60c7-17e5-4d3c-9f05-91d67aa9e4cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:01.477415 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-83bc60c7-17e5-4d3c-9f05-91d67aa9e4cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:01.484378 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-83bc60c7-17e5-4d3c-9f05-91d67aa9e4cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:01.484854 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-83bc60c7-17e5-4d3c-9f05-91d67aa9e4cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:01.485288 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-83bc60c7-17e5-4d3c-9f05-91d67aa9e4cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:01.485967 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-83bc60c7-17e5-4d3c-9f05-91d67aa9e4cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:01.486411 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-83bc60c7-17e5-4d3c-9f05-91d67aa9e4cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:01.486824 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-83bc60c7-17e5-4d3c-9f05-91d67aa9e4cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:01.619416 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-83bc60c7-17e5-4d3c-9f05-91d67aa9e4cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:58:01.628446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-83bc60c7-17e5-4d3c-9f05-91d67aa9e4cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:58:01.629863 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-83bc60c7-17e5-4d3c-9f05-91d67aa9e4cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:58:01.631028 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-83bc60c7-17e5-4d3c-9f05-91d67aa9e4cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1729 microversion: 2.20 time: 0.158082 Oct 30 00:58:01.631567 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 428/875] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:58:01 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:58:02.657206 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-0a49551d-4256-4ac0-8c90-612b402df439 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:02.657904 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-0a49551d-4256-4ac0-8c90-612b402df439 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:02.663975 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0a49551d-4256-4ac0-8c90-612b402df439 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:02.664486 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0a49551d-4256-4ac0-8c90-612b402df439 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:02.664917 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0a49551d-4256-4ac0-8c90-612b402df439 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:02.665612 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0a49551d-4256-4ac0-8c90-612b402df439 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:02.666214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0a49551d-4256-4ac0-8c90-612b402df439 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:02.666633 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0a49551d-4256-4ac0-8c90-612b402df439 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:02.802520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-0a49551d-4256-4ac0-8c90-612b402df439 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:58:02.811249 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-0a49551d-4256-4ac0-8c90-612b402df439 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:58:02.812710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-0a49551d-4256-4ac0-8c90-612b402df439 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:58:02.813931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-0a49551d-4256-4ac0-8c90-612b402df439 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1729 microversion: 2.20 time: 0.161954 Oct 30 00:58:02.814564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 448/876] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:58:02 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:58:03.839296 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f0d891bf-4182-4271-a044-3a5d59939092 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:03.839894 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f0d891bf-4182-4271-a044-3a5d59939092 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:03.846625 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f0d891bf-4182-4271-a044-3a5d59939092 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:03.847097 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f0d891bf-4182-4271-a044-3a5d59939092 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:03.847520 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f0d891bf-4182-4271-a044-3a5d59939092 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:03.848231 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f0d891bf-4182-4271-a044-3a5d59939092 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:03.848678 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f0d891bf-4182-4271-a044-3a5d59939092 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:03.849093 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f0d891bf-4182-4271-a044-3a5d59939092 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:03.979326 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f0d891bf-4182-4271-a044-3a5d59939092 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:58:03.987978 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f0d891bf-4182-4271-a044-3a5d59939092 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:58:03.989424 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f0d891bf-4182-4271-a044-3a5d59939092 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:58:03.990560 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f0d891bf-4182-4271-a044-3a5d59939092 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1716 microversion: 2.20 time: 0.155408 Oct 30 00:58:03.991095 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 429/877] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:58:03 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:58:24.420304 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c63df954-c134-4a82-8809-98b1bd12930c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:24.421632 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c63df954-c134-4a82-8809-98b1bd12930c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:24.423363 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:24.424200 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:24.431515 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c63df954-c134-4a82-8809-98b1bd12930c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:24.431996 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c63df954-c134-4a82-8809-98b1bd12930c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:24.432460 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c63df954-c134-4a82-8809-98b1bd12930c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:24.433155 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c63df954-c134-4a82-8809-98b1bd12930c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:24.433608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c63df954-c134-4a82-8809-98b1bd12930c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:24.434031 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c63df954-c134-4a82-8809-98b1bd12930c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:24.459081 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c63df954-c134-4a82-8809-98b1bd12930c tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/ips" status: 200 len: 145 microversion: 2.1 time: 0.042899 Oct 30 00:58:24.459642 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 449/878] 10.222.0.36 () {58 vars in 1248 bytes} [Sun Oct 30 00:58:24 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:58:25.797050 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f926efb7-f13c-4b0e-b7b4-280a8cce779e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1df07c6a-b6bf-4cdc-9f7e-4c255ea2ed22"}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:58:25.799451 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f926efb7-f13c-4b0e-b7b4-280a8cce779e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:25.801488 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=27 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:25.802267 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:25.807928 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f926efb7-f13c-4b0e-b7b4-280a8cce779e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:25.808454 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f926efb7-f13c-4b0e-b7b4-280a8cce779e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:25.808882 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f926efb7-f13c-4b0e-b7b4-280a8cce779e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:25.809579 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f926efb7-f13c-4b0e-b7b4-280a8cce779e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:25.810040 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f926efb7-f13c-4b0e-b7b4-280a8cce779e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:25.810462 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f926efb7-f13c-4b0e-b7b4-280a8cce779e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:26.175347 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f926efb7-f13c-4b0e-b7b4-280a8cce779e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "POST /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.382779 Oct 30 00:58:26.175991 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 430/879] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Oct 30 00:58:25 2022] POST /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-volume_attachments => generated 194 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:58:33.847654 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ef5bf975-ac2d-4982-b50f-0a5b44b3abd3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:33.849808 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ef5bf975-ac2d-4982-b50f-0a5b44b3abd3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:33.856581 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ef5bf975-ac2d-4982-b50f-0a5b44b3abd3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:33.857056 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ef5bf975-ac2d-4982-b50f-0a5b44b3abd3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:33.857484 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ef5bf975-ac2d-4982-b50f-0a5b44b3abd3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:33.858160 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ef5bf975-ac2d-4982-b50f-0a5b44b3abd3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:33.858606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ef5bf975-ac2d-4982-b50f-0a5b44b3abd3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:33.859019 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ef5bf975-ac2d-4982-b50f-0a5b44b3abd3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:33.891538 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ef5bf975-ac2d-4982-b50f-0a5b44b3abd3 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047823 Oct 30 00:58:33.892116 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 450/880] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Oct 30 00:58:33 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 00:58:33.904209 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-4e141b83-8e08-4992-a7b4-d60f0b3c69f5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:33.904786 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-4e141b83-8e08-4992-a7b4-d60f0b3c69f5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:33.911518 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4e141b83-8e08-4992-a7b4-d60f0b3c69f5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:33.911997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4e141b83-8e08-4992-a7b4-d60f0b3c69f5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:33.912469 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4e141b83-8e08-4992-a7b4-d60f0b3c69f5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:33.913156 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4e141b83-8e08-4992-a7b4-d60f0b3c69f5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:33.913608 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4e141b83-8e08-4992-a7b4-d60f0b3c69f5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:33.914021 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4e141b83-8e08-4992-a7b4-d60f0b3c69f5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:33.942947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-4e141b83-8e08-4992-a7b4-d60f0b3c69f5 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-volume_attachments/1df07c6a-b6bf-4cdc-9f7e-4c255ea2ed22" status: 200 len: 194 microversion: 2.1 time: 0.043961 Oct 30 00:58:33.943506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 431/881] 10.222.0.36 () {58 vars in 1413 bytes} [Sun Oct 30 00:58:33 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-volume_attachments/1df07c6a-b6bf-4cdc-9f7e-4c255ea2ed22 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:58:35.274496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-756606c5-b64b-44b4-838a-84a4854328d9 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9cdd114-f711-4091-aaad-f41d775e0e0c"}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:58:35.276811 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-756606c5-b64b-44b4-838a-84a4854328d9 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:35.283857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-756606c5-b64b-44b4-838a-84a4854328d9 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:35.284359 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-756606c5-b64b-44b4-838a-84a4854328d9 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:35.284786 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-756606c5-b64b-44b4-838a-84a4854328d9 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:35.285457 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-756606c5-b64b-44b4-838a-84a4854328d9 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:35.285899 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-756606c5-b64b-44b4-838a-84a4854328d9 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:35.286307 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-756606c5-b64b-44b4-838a-84a4854328d9 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:35.751773 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-756606c5-b64b-44b4-838a-84a4854328d9 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "POST /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.480307 Oct 30 00:58:35.752545 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 451/882] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Oct 30 00:58:35 2022] POST /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-volume_attachments => generated 194 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:58:43.291898 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-4345d234-87c9-47ad-a806-3ae8c6c9ad9e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:43.294112 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-4345d234-87c9-47ad-a806-3ae8c6c9ad9e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:43.301961 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4345d234-87c9-47ad-a806-3ae8c6c9ad9e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:43.302439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4345d234-87c9-47ad-a806-3ae8c6c9ad9e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:43.302872 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4345d234-87c9-47ad-a806-3ae8c6c9ad9e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:43.303554 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4345d234-87c9-47ad-a806-3ae8c6c9ad9e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:43.303998 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4345d234-87c9-47ad-a806-3ae8c6c9ad9e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:43.304445 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4345d234-87c9-47ad-a806-3ae8c6c9ad9e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:43.334095 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-4345d234-87c9-47ad-a806-3ae8c6c9ad9e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046067 Oct 30 00:58:43.334623 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 432/883] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Oct 30 00:58:43 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:58:43.477983 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-62c1e7eb-4b4e-49f1-be4b-f8c934f171ed tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:43.478525 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-62c1e7eb-4b4e-49f1-be4b-f8c934f171ed tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:43.484740 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-62c1e7eb-4b4e-49f1-be4b-f8c934f171ed tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:43.485217 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-62c1e7eb-4b4e-49f1-be4b-f8c934f171ed tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:43.485649 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-62c1e7eb-4b4e-49f1-be4b-f8c934f171ed tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:43.486334 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-62c1e7eb-4b4e-49f1-be4b-f8c934f171ed tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:43.486803 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-62c1e7eb-4b4e-49f1-be4b-f8c934f171ed tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:43.487284 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-62c1e7eb-4b4e-49f1-be4b-f8c934f171ed tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:43.517161 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-62c1e7eb-4b4e-49f1-be4b-f8c934f171ed tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-volume_attachments/1df07c6a-b6bf-4cdc-9f7e-4c255ea2ed22" status: 200 len: 194 microversion: 2.1 time: 0.043980 Oct 30 00:58:43.517741 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 452/884] 10.222.0.36 () {58 vars in 1413 bytes} [Sun Oct 30 00:58:43 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-volume_attachments/1df07c6a-b6bf-4cdc-9f7e-4c255ea2ed22 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:58:43.528746 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-51d15247-bfbd-47ea-9e93-d9d6156ae244 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:43.529235 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-51d15247-bfbd-47ea-9e93-d9d6156ae244 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:43.536358 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-51d15247-bfbd-47ea-9e93-d9d6156ae244 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:43.536841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-51d15247-bfbd-47ea-9e93-d9d6156ae244 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:43.537305 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-51d15247-bfbd-47ea-9e93-d9d6156ae244 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:43.537996 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-51d15247-bfbd-47ea-9e93-d9d6156ae244 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:43.538448 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-51d15247-bfbd-47ea-9e93-d9d6156ae244 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:43.538874 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-51d15247-bfbd-47ea-9e93-d9d6156ae244 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:43.618748 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.objects.instance [None req-51d15247-bfbd-47ea-9e93-d9d6156ae244 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lazy-loading 'services' on Instance uuid ee562908-833e-4e3b-9a81-a997b182d64f {{(pid=125553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:58:43.689056 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-51d15247-bfbd-47ea-9e93-d9d6156ae244 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-volume_attachments/1df07c6a-b6bf-4cdc-9f7e-4c255ea2ed22" status: 202 len: 0 microversion: 2.1 time: 0.163927 Oct 30 00:58:43.689640 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 433/885] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Oct 30 00:58:43 2022] DELETE /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-volume_attachments/1df07c6a-b6bf-4cdc-9f7e-4c255ea2ed22 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 00:58:44.812347 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7ea01973-cb9c-4c4b-8d8d-e365b5226ef6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:44.812887 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-7ea01973-cb9c-4c4b-8d8d-e365b5226ef6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:44.820582 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7ea01973-cb9c-4c4b-8d8d-e365b5226ef6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:44.821064 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7ea01973-cb9c-4c4b-8d8d-e365b5226ef6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:44.821491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7ea01973-cb9c-4c4b-8d8d-e365b5226ef6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:44.822178 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7ea01973-cb9c-4c4b-8d8d-e365b5226ef6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:44.822619 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7ea01973-cb9c-4c4b-8d8d-e365b5226ef6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:44.823031 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7ea01973-cb9c-4c4b-8d8d-e365b5226ef6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:44.853248 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7ea01973-cb9c-4c4b-8d8d-e365b5226ef6 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-volume_attachments/a9cdd114-f711-4091-aaad-f41d775e0e0c" status: 200 len: 194 microversion: 2.1 time: 0.044879 Oct 30 00:58:44.853837 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 453/886] 10.222.0.36 () {58 vars in 1413 bytes} [Sun Oct 30 00:58:44 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-volume_attachments/a9cdd114-f711-4091-aaad-f41d775e0e0c => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:58:44.865799 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5976af72-7972-42d3-bc05-84aaf4a2ab82 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:44.867192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5976af72-7972-42d3-bc05-84aaf4a2ab82 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:44.874768 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5976af72-7972-42d3-bc05-84aaf4a2ab82 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:44.875970 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5976af72-7972-42d3-bc05-84aaf4a2ab82 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:44.875970 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5976af72-7972-42d3-bc05-84aaf4a2ab82 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:44.876686 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5976af72-7972-42d3-bc05-84aaf4a2ab82 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:44.877155 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5976af72-7972-42d3-bc05-84aaf4a2ab82 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:44.879524 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5976af72-7972-42d3-bc05-84aaf4a2ab82 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:44.961791 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.objects.instance [None req-5976af72-7972-42d3-bc05-84aaf4a2ab82 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lazy-loading 'services' on Instance uuid ee562908-833e-4e3b-9a81-a997b182d64f {{(pid=125553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:58:45.032834 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5976af72-7972-42d3-bc05-84aaf4a2ab82 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-volume_attachments/a9cdd114-f711-4091-aaad-f41d775e0e0c" status: 202 len: 0 microversion: 2.1 time: 0.171844 Oct 30 00:58:45.033360 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 434/887] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Oct 30 00:58:44 2022] DELETE /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-volume_attachments/a9cdd114-f711-4091-aaad-f41d775e0e0c => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 00:58:46.203623 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d673bba4-5473-498f-ad2a-db34536986c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:46.206536 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-d673bba4-5473-498f-ad2a-db34536986c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:46.213278 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d673bba4-5473-498f-ad2a-db34536986c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:46.213752 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d673bba4-5473-498f-ad2a-db34536986c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:46.214181 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d673bba4-5473-498f-ad2a-db34536986c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:46.215110 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d673bba4-5473-498f-ad2a-db34536986c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:46.215556 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d673bba4-5473-498f-ad2a-db34536986c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:46.215973 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d673bba4-5473-498f-ad2a-db34536986c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:46.243919 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-d673bba4-5473-498f-ad2a-db34536986c8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044150 Oct 30 00:58:46.244466 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 454/888] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Oct 30 00:58:46 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 00:58:46.363466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a4b8c985-0c65-4bab-8243-7216bf9240cc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:46.365834 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a4b8c985-0c65-4bab-8243-7216bf9240cc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:46.371808 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a4b8c985-0c65-4bab-8243-7216bf9240cc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:46.372330 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a4b8c985-0c65-4bab-8243-7216bf9240cc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:46.372762 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a4b8c985-0c65-4bab-8243-7216bf9240cc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:46.373445 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a4b8c985-0c65-4bab-8243-7216bf9240cc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:46.373886 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a4b8c985-0c65-4bab-8243-7216bf9240cc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:46.374304 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a4b8c985-0c65-4bab-8243-7216bf9240cc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:46.403929 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a4b8c985-0c65-4bab-8243-7216bf9240cc tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045698 Oct 30 00:58:46.404482 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 435/889] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Oct 30 00:58:46 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 00:58:46.467805 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f41324f3-aa2e-4e4e-a160-b35d6ce5d531 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:46.468323 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-f41324f3-aa2e-4e4e-a160-b35d6ce5d531 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:46.474196 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f41324f3-aa2e-4e4e-a160-b35d6ce5d531 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:46.474678 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f41324f3-aa2e-4e4e-a160-b35d6ce5d531 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:46.475112 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f41324f3-aa2e-4e4e-a160-b35d6ce5d531 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:46.475797 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f41324f3-aa2e-4e4e-a160-b35d6ce5d531 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:46.476288 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f41324f3-aa2e-4e4e-a160-b35d6ce5d531 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:46.476810 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f41324f3-aa2e-4e4e-a160-b35d6ce5d531 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:46.501467 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-f41324f3-aa2e-4e4e-a160-b35d6ce5d531 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Going to try to terminate instance {{(pid=125554) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 00:58:46.583495 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-f41324f3-aa2e-4e4e-a160-b35d6ce5d531 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 204 len: 0 microversion: 2.1 time: 0.119456 Oct 30 00:58:46.584112 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 455/890] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 00:58:46 2022] DELETE /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 00:58:46.592518 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-71e16fa5-4aab-4867-bc22-9abefbd554d8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:46.593124 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-71e16fa5-4aab-4867-bc22-9abefbd554d8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:46.599003 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-71e16fa5-4aab-4867-bc22-9abefbd554d8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:46.599480 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-71e16fa5-4aab-4867-bc22-9abefbd554d8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:46.599914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-71e16fa5-4aab-4867-bc22-9abefbd554d8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:46.600634 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-71e16fa5-4aab-4867-bc22-9abefbd554d8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:46.601087 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-71e16fa5-4aab-4867-bc22-9abefbd554d8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:46.601509 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-71e16fa5-4aab-4867-bc22-9abefbd554d8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:46.731214 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-71e16fa5-4aab-4867-bc22-9abefbd554d8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:58:46.739604 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-71e16fa5-4aab-4867-bc22-9abefbd554d8 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 200 len: 1672 microversion: 2.1 time: 0.151196 Oct 30 00:58:46.740254 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 436/891] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:58:46 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:58:47.763363 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-83bf2d06-9747-456c-a676-a3dc70f88b06 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:47.764069 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-83bf2d06-9747-456c-a676-a3dc70f88b06 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:47.771258 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-83bf2d06-9747-456c-a676-a3dc70f88b06 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:47.771744 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-83bf2d06-9747-456c-a676-a3dc70f88b06 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:47.772212 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-83bf2d06-9747-456c-a676-a3dc70f88b06 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:47.772909 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-83bf2d06-9747-456c-a676-a3dc70f88b06 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:47.773390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-83bf2d06-9747-456c-a676-a3dc70f88b06 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:47.773815 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-83bf2d06-9747-456c-a676-a3dc70f88b06 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:47.903012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-83bf2d06-9747-456c-a676-a3dc70f88b06 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:58:47.910905 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-83bf2d06-9747-456c-a676-a3dc70f88b06 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 200 len: 1672 microversion: 2.1 time: 0.151835 Oct 30 00:58:47.911464 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 456/892] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:58:47 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:58:48.934554 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-fbcfbcb9-70ee-455e-8fb7-04101b383ad2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:48.935164 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-fbcfbcb9-70ee-455e-8fb7-04101b383ad2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:48.942680 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbcfbcb9-70ee-455e-8fb7-04101b383ad2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:48.943163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbcfbcb9-70ee-455e-8fb7-04101b383ad2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:48.943591 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbcfbcb9-70ee-455e-8fb7-04101b383ad2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:48.944331 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbcfbcb9-70ee-455e-8fb7-04101b383ad2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:48.944786 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbcfbcb9-70ee-455e-8fb7-04101b383ad2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:48.945209 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbcfbcb9-70ee-455e-8fb7-04101b383ad2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:49.077729 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fbcfbcb9-70ee-455e-8fb7-04101b383ad2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:58:49.086430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-fbcfbcb9-70ee-455e-8fb7-04101b383ad2 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 200 len: 1672 microversion: 2.1 time: 0.155710 Oct 30 00:58:49.086982 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 437/893] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:58:48 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:58:49.683573 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-6d1c24fc-82d2-4293-a24b-2a5f97cacebf req-b1d760a7-6076-4d08-9da1-d145cb06ba86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee562908-833e-4e3b-9a81-a997b182d64f", "name": "network-vif-deleted", "tag": "28b8bae2-57d2-4a52-9ea0-362137ed5701"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:58:49.700362 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-6d1c24fc-82d2-4293-a24b-2a5f97cacebf req-b1d760a7-6076-4d08-9da1-d145cb06ba86 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:49.700929 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-6d1c24fc-82d2-4293-a24b-2a5f97cacebf req-b1d760a7-6076-4d08-9da1-d145cb06ba86 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:49.701424 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-6d1c24fc-82d2-4293-a24b-2a5f97cacebf req-b1d760a7-6076-4d08-9da1-d145cb06ba86 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:49.712916 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-6d1c24fc-82d2-4293-a24b-2a5f97cacebf req-b1d760a7-6076-4d08-9da1-d145cb06ba86 service nova] Creating event network-vif-deleted:28b8bae2-57d2-4a52-9ea0-362137ed5701 for instance ee562908-833e-4e3b-9a81-a997b182d64f on hv-cinder-86149 Oct 30 00:58:49.718532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-6d1c24fc-82d2-4293-a24b-2a5f97cacebf req-b1d760a7-6076-4d08-9da1-d145cb06ba86 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038597 Oct 30 00:58:49.720221 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 457/894] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:58:50.109953 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1357a90c-eae1-4ac2-9114-365142ed6e1d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:50.110650 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1357a90c-eae1-4ac2-9114-365142ed6e1d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:50.117613 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1357a90c-eae1-4ac2-9114-365142ed6e1d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:50.118099 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1357a90c-eae1-4ac2-9114-365142ed6e1d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:50.118529 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1357a90c-eae1-4ac2-9114-365142ed6e1d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:50.119215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1357a90c-eae1-4ac2-9114-365142ed6e1d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:50.119661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1357a90c-eae1-4ac2-9114-365142ed6e1d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:50.120073 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1357a90c-eae1-4ac2-9114-365142ed6e1d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:50.152178 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1357a90c-eae1-4ac2-9114-365142ed6e1d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:50.152688 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1357a90c-eae1-4ac2-9114-365142ed6e1d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:50.153120 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1357a90c-eae1-4ac2-9114-365142ed6e1d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:50.153560 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.objects.instance [None req-1357a90c-eae1-4ac2-9114-365142ed6e1d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lazy-loading 'fault' on Instance uuid ee562908-833e-4e3b-9a81-a997b182d64f {{(pid=125553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 00:58:50.195185 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1357a90c-eae1-4ac2-9114-365142ed6e1d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac3fdb86ac24fa493706f84e1aa40a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb5d551adcf64bb8aea88a6c142cea5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:58:50.203241 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1357a90c-eae1-4ac2-9114-365142ed6e1d tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 200 len: 1327 microversion: 2.1 time: 0.097104 Oct 30 00:58:50.204022 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 438/895] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:58:50 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 1327 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:58:51.228453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4e37ac94-db8f-4c42-8344-cfe50440102a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:51.229175 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-4e37ac94-db8f-4c42-8344-cfe50440102a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:51.235339 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e37ac94-db8f-4c42-8344-cfe50440102a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:51.235813 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e37ac94-db8f-4c42-8344-cfe50440102a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:51.236272 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e37ac94-db8f-4c42-8344-cfe50440102a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:51.236957 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e37ac94-db8f-4c42-8344-cfe50440102a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:51.237958 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e37ac94-db8f-4c42-8344-cfe50440102a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:51.238398 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e37ac94-db8f-4c42-8344-cfe50440102a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:51.251334 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-4e37ac94-db8f-4c42-8344-cfe50440102a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] HTTP exception thrown: Instance ee562908-833e-4e3b-9a81-a997b182d64f could not be found. Oct 30 00:58:51.253667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4e37ac94-db8f-4c42-8344-cfe50440102a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Request method failure captured: Oct 30 00:58:51.253667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f HTTP/1.1 Oct 30 00:58:51.253667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 00:58:51.253667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 00:58:51.253667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 00:58:51.253667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 00:58:51.253667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 00:58:51.253667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 00:58:51.253667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 00:58:51.253667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 00:58:51.253667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcncSCX4qCQkCbcXRF8C3GwJzgcHekPX9qdL8L6lp7kW4TRY-vYdvmpT4Pu512PpLQ1yiOhFdX0mkBm6TJhIfYQt7Qmaq8c1P_rGyNDdA6A-vokS378YTc5598sJi2oiTlZPaNF8-lOqerJotyoXjiAxsr9X9razgtO4kuuLnqzLJ48 Oct 30 00:58:51.253667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 00:58:51.253667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 00:58:51.253667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 00:58:51.253667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 00:58:51.253667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 00:58:51.253667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 00:58:51.253667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: bb5d551adcf64bb8aea88a6c142cea5e Oct 30 00:58:51.253667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-AttachVolumeTestJSON-354791381 Oct 30 00:58:51.253667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 00:58:51.253667 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 00:58:51.255197 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:58:51.255197 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-AttachVolumeTestJSON-354791381 Oct 30 00:58:51.255197 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: bb5d551adcf64bb8aea88a6c142cea5e Oct 30 00:58:51.255197 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-AttachVolumeTestJSON-354791381 Oct 30 00:58:51.255197 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-AttachVolumeTestJSON-354791381-project Oct 30 00:58:51.255197 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 00:58:51.255197 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 00:58:51.255197 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 5ac3fdb86ac24fa493706f84e1aa40a8 Oct 30 00:58:51.255197 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-AttachVolumeTestJSON-354791381-project Oct 30 00:58:51.255197 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 00:58:51.255197 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Instance ee562908-833e-4e3b-9a81-a997b182d64f could not be found. Oct 30 00:58:51.255197 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': 'ee562908-833e-4e3b-9a81-a997b182d64f'} Oct 30 00:58:51.255994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:58:51.255994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:58:51.255994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:58:51.255994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:58:51.255994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:58:51.255994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:58:51.255994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:58:51.255994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:58:51.255994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:58:51.255994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:58:51.255994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee562908-833e-4e3b-9a81-a997b182d64f could not be found. Oct 30 00:58:51.255994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:58:51.255994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:58:51.255994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:58:51.255994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:58:51.255994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:58:51.255994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:58:51.255994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:58:51.255994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:58:51.255994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:58:51.257520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:58:51.257520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 00:58:51.257520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 00:58:51.257520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:58:51.257520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:58:51.257520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:58:51.257520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:58:51.257520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee562908-833e-4e3b-9a81-a997b182d64f could not be found. Oct 30 00:58:51.257520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:58:51.257520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:58:51.257520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:58:51.257520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:58:51.257520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:58:51.257520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:58:51.257520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:58:51.257520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:58:51.257520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee562908-833e-4e3b-9a81-a997b182d64f could not be found. Oct 30 00:58:51.257520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:58:51.258838 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4e37ac94-db8f-4c42-8344-cfe50440102a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Returning 404 to user: Instance ee562908-833e-4e3b-9a81-a997b182d64f could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:58:51.258838 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-4e37ac94-db8f-4c42-8344-cfe50440102a tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 404 len: 111 microversion: 2.1 time: 0.031457 Oct 30 00:58:51.258838 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 458/896] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:58:51 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 00:58:51.263898 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e02d9d7a-bbbb-4692-8224-71bdf0751e64 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '.version_select at 0x7faf759f5d30>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:51.283051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e02d9d7a-bbbb-4692-8224-71bdf0751e64 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-727878017" status: 202 len: 0 microversion: 2.1 time: 0.022908 Oct 30 00:58:51.283608 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 439/897] 10.222.0.36 () {58 vars in 1218 bytes} [Sun Oct 30 00:58:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-727878017 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 00:58:54.172052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-84bc693b-fa07-4c2e-bbf1-afca3ee5dd37 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:54.172607 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-84bc693b-fa07-4c2e-bbf1-afca3ee5dd37 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:54.179307 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-84bc693b-fa07-4c2e-bbf1-afca3ee5dd37 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:54.179815 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-84bc693b-fa07-4c2e-bbf1-afca3ee5dd37 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:54.180273 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-84bc693b-fa07-4c2e-bbf1-afca3ee5dd37 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:54.180951 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-84bc693b-fa07-4c2e-bbf1-afca3ee5dd37 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:54.181394 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-84bc693b-fa07-4c2e-bbf1-afca3ee5dd37 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:54.181809 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-84bc693b-fa07-4c2e-bbf1-afca3ee5dd37 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:54.195405 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-84bc693b-fa07-4c2e-bbf1-afca3ee5dd37 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] HTTP exception thrown: Instance ee562908-833e-4e3b-9a81-a997b182d64f could not be found. Oct 30 00:58:54.196952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-84bc693b-fa07-4c2e-bbf1-afca3ee5dd37 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Request method failure captured: Oct 30 00:58:54.196952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: DELETE /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f HTTP/1.1 Oct 30 00:58:54.196952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 00:58:54.196952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 00:58:54.196952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 00:58:54.196952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 00:58:54.196952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 00:58:54.196952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 00:58:54.196952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 00:58:54.196952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 00:58:54.196952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcncSCX4qCQkCbcXRF8C3GwJzgcHekPX9qdL8L6lp7kW4TRY-vYdvmpT4Pu512PpLQ1yiOhFdX0mkBm6TJhIfYQt7Qmaq8c1P_rGyNDdA6A-vokS378YTc5598sJi2oiTlZPaNF8-lOqerJotyoXjiAxsr9X9razgtO4kuuLnqzLJ48 Oct 30 00:58:54.196952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 00:58:54.196952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 00:58:54.196952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 00:58:54.196952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 00:58:54.196952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 00:58:54.196952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 00:58:54.196952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: bb5d551adcf64bb8aea88a6c142cea5e Oct 30 00:58:54.196952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-AttachVolumeTestJSON-354791381 Oct 30 00:58:54.196952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 00:58:54.196952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 00:58:54.198609 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:58:54.198609 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-AttachVolumeTestJSON-354791381 Oct 30 00:58:54.198609 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: bb5d551adcf64bb8aea88a6c142cea5e Oct 30 00:58:54.198609 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-AttachVolumeTestJSON-354791381 Oct 30 00:58:54.198609 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-AttachVolumeTestJSON-354791381-project Oct 30 00:58:54.198609 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 00:58:54.198609 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 00:58:54.198609 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 5ac3fdb86ac24fa493706f84e1aa40a8 Oct 30 00:58:54.198609 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-AttachVolumeTestJSON-354791381-project Oct 30 00:58:54.198609 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 00:58:54.198609 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Instance ee562908-833e-4e3b-9a81-a997b182d64f could not be found. Oct 30 00:58:54.198609 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': 'ee562908-833e-4e3b-9a81-a997b182d64f'} Oct 30 00:58:54.199529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:58:54.199529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:58:54.199529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:58:54.199529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:58:54.199529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:58:54.199529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:58:54.199529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:58:54.199529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:58:54.199529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:58:54.199529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:58:54.199529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee562908-833e-4e3b-9a81-a997b182d64f could not be found. Oct 30 00:58:54.199529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:58:54.199529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:58:54.199529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:58:54.199529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:58:54.199529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:58:54.199529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:58:54.199529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:58:54.199529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:58:54.199529 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:58:54.201105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:58:54.201105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 00:58:54.201105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 00:58:54.201105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 00:58:54.201105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 00:58:54.201105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:58:54.201105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:58:54.201105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:58:54.201105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:58:54.201105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee562908-833e-4e3b-9a81-a997b182d64f could not be found. Oct 30 00:58:54.201105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:58:54.201105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:58:54.201105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:58:54.201105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:58:54.201105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:58:54.201105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:58:54.201105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:58:54.201105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:58:54.201105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee562908-833e-4e3b-9a81-a997b182d64f could not be found. Oct 30 00:58:54.201105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:58:54.202780 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-84bc693b-fa07-4c2e-bbf1-afca3ee5dd37 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Returning 404 to user: Instance ee562908-833e-4e3b-9a81-a997b182d64f could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:58:54.202780 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-84bc693b-fa07-4c2e-bbf1-afca3ee5dd37 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 404 len: 111 microversion: 2.1 time: 0.030054 Oct 30 00:58:54.202780 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 459/898] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 00:58:54 2022] DELETE /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 00:58:54.206567 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-0535f1cb-e956-4088-a95e-41f9a04cc102 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:54.207168 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-0535f1cb-e956-4088-a95e-41f9a04cc102 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: ee562908-833e-4e3b-9a81-a997b182d64f] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:54.214544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0535f1cb-e956-4088-a95e-41f9a04cc102 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:54.215022 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0535f1cb-e956-4088-a95e-41f9a04cc102 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:54.215705 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0535f1cb-e956-4088-a95e-41f9a04cc102 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:54.216423 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0535f1cb-e956-4088-a95e-41f9a04cc102 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:54.216869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0535f1cb-e956-4088-a95e-41f9a04cc102 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:54.217285 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0535f1cb-e956-4088-a95e-41f9a04cc102 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:54.230386 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-0535f1cb-e956-4088-a95e-41f9a04cc102 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] HTTP exception thrown: Instance ee562908-833e-4e3b-9a81-a997b182d64f could not be found. Oct 30 00:58:54.231997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-0535f1cb-e956-4088-a95e-41f9a04cc102 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Request method failure captured: Oct 30 00:58:54.231997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f HTTP/1.1 Oct 30 00:58:54.231997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 00:58:54.231997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 00:58:54.231997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 00:58:54.231997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 00:58:54.231997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 00:58:54.231997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 00:58:54.231997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 00:58:54.231997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 00:58:54.231997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXcncSCX4qCQkCbcXRF8C3GwJzgcHekPX9qdL8L6lp7kW4TRY-vYdvmpT4Pu512PpLQ1yiOhFdX0mkBm6TJhIfYQt7Qmaq8c1P_rGyNDdA6A-vokS378YTc5598sJi2oiTlZPaNF8-lOqerJotyoXjiAxsr9X9razgtO4kuuLnqzLJ48 Oct 30 00:58:54.231997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 00:58:54.231997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 00:58:54.231997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 00:58:54.231997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 00:58:54.231997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 00:58:54.231997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 00:58:54.231997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: bb5d551adcf64bb8aea88a6c142cea5e Oct 30 00:58:54.231997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-AttachVolumeTestJSON-354791381 Oct 30 00:58:54.231997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 00:58:54.231997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 00:58:54.233669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:58:54.233669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-AttachVolumeTestJSON-354791381 Oct 30 00:58:54.233669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: bb5d551adcf64bb8aea88a6c142cea5e Oct 30 00:58:54.233669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-AttachVolumeTestJSON-354791381 Oct 30 00:58:54.233669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-AttachVolumeTestJSON-354791381-project Oct 30 00:58:54.233669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 00:58:54.233669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 00:58:54.233669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: 5ac3fdb86ac24fa493706f84e1aa40a8 Oct 30 00:58:54.233669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-AttachVolumeTestJSON-354791381-project Oct 30 00:58:54.233669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: > Oct 30 00:58:54.233669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Instance ee562908-833e-4e3b-9a81-a997b182d64f could not be found. Oct 30 00:58:54.233669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': 'ee562908-833e-4e3b-9a81-a997b182d64f'} Oct 30 00:58:54.234541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:58:54.234541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:58:54.234541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:58:54.234541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:58:54.234541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:58:54.234541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:58:54.234541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:58:54.234541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:58:54.234541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:58:54.234541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:58:54.234541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee562908-833e-4e3b-9a81-a997b182d64f could not be found. Oct 30 00:58:54.234541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:58:54.234541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:58:54.234541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:58:54.234541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:58:54.234541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:58:54.234541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:58:54.234541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:58:54.234541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:58:54.234541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:58:54.235987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:58:54.235987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 00:58:54.235987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 00:58:54.235987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:58:54.235987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:58:54.235987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:58:54.235987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:58:54.235987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee562908-833e-4e3b-9a81-a997b182d64f could not be found. Oct 30 00:58:54.235987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:58:54.235987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:58:54.235987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:58:54.235987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:58:54.235987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:58:54.235987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:58:54.235987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:58:54.235987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:58:54.235987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee562908-833e-4e3b-9a81-a997b182d64f could not be found. Oct 30 00:58:54.235987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:58:54.237274 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-0535f1cb-e956-4088-a95e-41f9a04cc102 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Returning 404 to user: Instance ee562908-833e-4e3b-9a81-a997b182d64f could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:58:54.237274 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-0535f1cb-e956-4088-a95e-41f9a04cc102 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f" status: 404 len: 111 microversion: 2.1 time: 0.030628 Oct 30 00:58:54.237274 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 440/899] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:58:54 2022] GET /compute/v2.1/servers/ee562908-833e-4e3b-9a81-a997b182d64f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 00:58:55.380191 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7e076ff2-4c08-424c-92e0-63183cc64811 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:55.380693 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-7e076ff2-4c08-424c-92e0-63183cc64811 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:55.383048 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:55.388337 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7e076ff2-4c08-424c-92e0-63183cc64811 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:55.388814 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7e076ff2-4c08-424c-92e0-63183cc64811 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:55.389244 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7e076ff2-4c08-424c-92e0-63183cc64811 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:55.389921 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7e076ff2-4c08-424c-92e0-63183cc64811 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:55.390364 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7e076ff2-4c08-424c-92e0-63183cc64811 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:55.390778 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7e076ff2-4c08-424c-92e0-63183cc64811 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:55.396264 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:55.407001 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-7e076ff2-4c08-424c-92e0-63183cc64811 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] HTTP exception thrown: Instance 4250f845-2f85-48d9-bf11-5b7093520b26 could not be found. Oct 30 00:58:55.408703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7e076ff2-4c08-424c-92e0-63183cc64811 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Request method failure captured: Oct 30 00:58:55.408703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: DELETE /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 HTTP/1.1 Oct 30 00:58:55.408703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 00:58:55.408703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 00:58:55.408703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 00:58:55.408703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 00:58:55.408703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 00:58:55.408703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 00:58:55.408703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 00:58:55.408703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 00:58:55.408703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcncSCX4qCQkCbcXRF8C3GwJzgcHekPX9qdL8L6lp7kW4TRY-vYdvmpT4Pu512PpLQ1yiOhFdX0mkBm6TJhIfYQt7Qmaq8c1P_rGyNDdA6A-vokS378YTc5598sJi2oiTlZPaNF8-lOqerJotyoXjiAxsr9X9razgtO4kuuLnqzLJ48 Oct 30 00:58:55.408703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 00:58:55.408703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 00:58:55.408703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 00:58:55.408703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 00:58:55.408703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 00:58:55.408703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 00:58:55.408703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: bb5d551adcf64bb8aea88a6c142cea5e Oct 30 00:58:55.408703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-AttachVolumeTestJSON-354791381 Oct 30 00:58:55.408703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 00:58:55.408703 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 00:58:55.410155 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:58:55.410155 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-AttachVolumeTestJSON-354791381 Oct 30 00:58:55.410155 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: bb5d551adcf64bb8aea88a6c142cea5e Oct 30 00:58:55.410155 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-AttachVolumeTestJSON-354791381 Oct 30 00:58:55.410155 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-AttachVolumeTestJSON-354791381-project Oct 30 00:58:55.410155 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 00:58:55.410155 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 00:58:55.410155 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 5ac3fdb86ac24fa493706f84e1aa40a8 Oct 30 00:58:55.410155 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-AttachVolumeTestJSON-354791381-project Oct 30 00:58:55.410155 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 00:58:55.410155 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Instance 4250f845-2f85-48d9-bf11-5b7093520b26 could not be found. Oct 30 00:58:55.410155 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': '4250f845-2f85-48d9-bf11-5b7093520b26'} Oct 30 00:58:55.411645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:58:55.411645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:58:55.411645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:58:55.411645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:58:55.411645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:58:55.411645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:58:55.411645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:58:55.411645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:58:55.411645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:58:55.411645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:58:55.411645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4250f845-2f85-48d9-bf11-5b7093520b26 could not be found. Oct 30 00:58:55.411645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:58:55.411645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:58:55.411645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:58:55.411645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:58:55.411645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:58:55.411645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:58:55.411645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:58:55.411645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:58:55.411645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:58:55.413006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:58:55.413006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 00:58:55.413006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 00:58:55.413006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 00:58:55.413006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 00:58:55.413006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:58:55.413006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:58:55.413006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:58:55.413006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:58:55.413006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4250f845-2f85-48d9-bf11-5b7093520b26 could not be found. Oct 30 00:58:55.413006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:58:55.413006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:58:55.413006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:58:55.413006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:58:55.413006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:58:55.413006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:58:55.413006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:58:55.413006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:58:55.413006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4250f845-2f85-48d9-bf11-5b7093520b26 could not be found. Oct 30 00:58:55.413006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:58:55.414219 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7e076ff2-4c08-424c-92e0-63183cc64811 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Returning 404 to user: Instance 4250f845-2f85-48d9-bf11-5b7093520b26 could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:58:55.414219 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7e076ff2-4c08-424c-92e0-63183cc64811 tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 404 len: 111 microversion: 2.1 time: 0.033833 Oct 30 00:58:55.414219 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 460/900] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 00:58:55 2022] DELETE /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 00:58:55.420438 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-6ea7b17b-2d75-477b-bc70-bee2e15b3a9e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:55.421067 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-6ea7b17b-2d75-477b-bc70-bee2e15b3a9e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] [instance: 4250f845-2f85-48d9-bf11-5b7093520b26] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:55.427690 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6ea7b17b-2d75-477b-bc70-bee2e15b3a9e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:55.428206 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6ea7b17b-2d75-477b-bc70-bee2e15b3a9e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:55.428645 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6ea7b17b-2d75-477b-bc70-bee2e15b3a9e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:55.429334 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6ea7b17b-2d75-477b-bc70-bee2e15b3a9e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:55.429787 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6ea7b17b-2d75-477b-bc70-bee2e15b3a9e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:55.430210 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6ea7b17b-2d75-477b-bc70-bee2e15b3a9e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:55.443439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-6ea7b17b-2d75-477b-bc70-bee2e15b3a9e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] HTTP exception thrown: Instance 4250f845-2f85-48d9-bf11-5b7093520b26 could not be found. Oct 30 00:58:55.444977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-6ea7b17b-2d75-477b-bc70-bee2e15b3a9e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Request method failure captured: Oct 30 00:58:55.444977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 HTTP/1.1 Oct 30 00:58:55.444977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 00:58:55.444977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 00:58:55.444977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 00:58:55.444977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 00:58:55.444977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 00:58:55.444977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 00:58:55.444977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 00:58:55.444977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 00:58:55.444977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXcncSCX4qCQkCbcXRF8C3GwJzgcHekPX9qdL8L6lp7kW4TRY-vYdvmpT4Pu512PpLQ1yiOhFdX0mkBm6TJhIfYQt7Qmaq8c1P_rGyNDdA6A-vokS378YTc5598sJi2oiTlZPaNF8-lOqerJotyoXjiAxsr9X9razgtO4kuuLnqzLJ48 Oct 30 00:58:55.444977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 00:58:55.444977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 00:58:55.444977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 00:58:55.444977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 00:58:55.444977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 00:58:55.444977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 00:58:55.444977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: bb5d551adcf64bb8aea88a6c142cea5e Oct 30 00:58:55.444977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-AttachVolumeTestJSON-354791381 Oct 30 00:58:55.444977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 00:58:55.444977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 00:58:55.446584 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bb5d551adcf64bb8aea88a6c142cea5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:58:55.446584 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-AttachVolumeTestJSON-354791381 Oct 30 00:58:55.446584 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: bb5d551adcf64bb8aea88a6c142cea5e Oct 30 00:58:55.446584 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-AttachVolumeTestJSON-354791381 Oct 30 00:58:55.446584 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-AttachVolumeTestJSON-354791381-project Oct 30 00:58:55.446584 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 00:58:55.446584 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 00:58:55.446584 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: 5ac3fdb86ac24fa493706f84e1aa40a8 Oct 30 00:58:55.446584 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-AttachVolumeTestJSON-354791381-project Oct 30 00:58:55.446584 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: > Oct 30 00:58:55.446584 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Instance 4250f845-2f85-48d9-bf11-5b7093520b26 could not be found. Oct 30 00:58:55.446584 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': '4250f845-2f85-48d9-bf11-5b7093520b26'} Oct 30 00:58:55.447489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:58:55.447489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:58:55.447489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:58:55.447489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:58:55.447489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:58:55.447489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:58:55.447489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:58:55.447489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:58:55.447489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:58:55.447489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:58:55.447489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4250f845-2f85-48d9-bf11-5b7093520b26 could not be found. Oct 30 00:58:55.447489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:58:55.447489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:58:55.447489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:58:55.447489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:58:55.447489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:58:55.447489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:58:55.447489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:58:55.447489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:58:55.447489 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:58:55.448957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:58:55.448957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 00:58:55.448957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 00:58:55.448957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:58:55.448957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:58:55.448957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:58:55.448957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:58:55.448957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4250f845-2f85-48d9-bf11-5b7093520b26 could not be found. Oct 30 00:58:55.448957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:58:55.448957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:58:55.448957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:58:55.448957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:58:55.448957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:58:55.448957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:58:55.448957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:58:55.448957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:58:55.448957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4250f845-2f85-48d9-bf11-5b7093520b26 could not be found. Oct 30 00:58:55.448957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:58:55.450244 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-6ea7b17b-2d75-477b-bc70-bee2e15b3a9e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] Returning 404 to user: Instance 4250f845-2f85-48d9-bf11-5b7093520b26 could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:58:55.450244 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-6ea7b17b-2d75-477b-bc70-bee2e15b3a9e tempest-AttachVolumeTestJSON-354791381 tempest-AttachVolumeTestJSON-354791381-project] 10.222.0.36 "GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26" status: 404 len: 111 microversion: 2.1 time: 0.030812 Oct 30 00:58:55.450244 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 441/901] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:58:55 2022] GET /compute/v2.1/servers/4250f845-2f85-48d9-bf11-5b7093520b26 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 00:58:59.460403 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-3f06b636-d747-43eb-8d53-00ec57b1f6f6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:59.462436 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-3f06b636-d747-43eb-8d53-00ec57b1f6f6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:59.469828 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3f06b636-d747-43eb-8d53-00ec57b1f6f6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:59.470309 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3f06b636-d747-43eb-8d53-00ec57b1f6f6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:59.470743 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3f06b636-d747-43eb-8d53-00ec57b1f6f6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:59.471472 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3f06b636-d747-43eb-8d53-00ec57b1f6f6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:59.471928 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3f06b636-d747-43eb-8d53-00ec57b1f6f6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:59.472460 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3f06b636-d747-43eb-8d53-00ec57b1f6f6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:59.502415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-3f06b636-d747-43eb-8d53-00ec57b1f6f6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046863 Oct 30 00:58:59.502960 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 461/902] 10.222.0.36 () {60 vars in 1343 bytes} [Sun Oct 30 00:58:59 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 00:58:59.573912 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-7b250c5b-b49c-4a4c-837e-d2318d69400a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:59.574618 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-7b250c5b-b49c-4a4c-837e-d2318d69400a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:59.577203 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:59.583458 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7b250c5b-b49c-4a4c-837e-d2318d69400a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:59.584229 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7b250c5b-b49c-4a4c-837e-d2318d69400a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:59.584739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7b250c5b-b49c-4a4c-837e-d2318d69400a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:59.585710 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7b250c5b-b49c-4a4c-837e-d2318d69400a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:59.586620 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7b250c5b-b49c-4a4c-837e-d2318d69400a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:59.587121 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7b250c5b-b49c-4a4c-837e-d2318d69400a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:59.592762 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:58:59.619034 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-7b250c5b-b49c-4a4c-837e-d2318d69400a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Going to try to terminate instance {{(pid=125553) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 00:58:59.697072 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-7b250c5b-b49c-4a4c-837e-d2318d69400a tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 204 len: 0 microversion: 2.20 time: 0.126970 Oct 30 00:58:59.698265 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 442/903] 10.222.0.36 () {60 vars in 1280 bytes} [Sun Oct 30 00:58:59 2022] DELETE /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 00:58:59.707602 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-5e905def-28a2-4061-92c7-aa23c30354e5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:58:59.708826 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-5e905def-28a2-4061-92c7-aa23c30354e5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:58:59.715085 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5e905def-28a2-4061-92c7-aa23c30354e5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:59.715893 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5e905def-28a2-4061-92c7-aa23c30354e5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:59.716361 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5e905def-28a2-4061-92c7-aa23c30354e5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:59.717053 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5e905def-28a2-4061-92c7-aa23c30354e5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:58:59.717678 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5e905def-28a2-4061-92c7-aa23c30354e5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:58:59.718101 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5e905def-28a2-4061-92c7-aa23c30354e5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:58:59.853429 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-5e905def-28a2-4061-92c7-aa23c30354e5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:58:59.861583 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-5e905def-28a2-4061-92c7-aa23c30354e5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:58:59.862991 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-5e905def-28a2-4061-92c7-aa23c30354e5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:58:59.864166 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-5e905def-28a2-4061-92c7-aa23c30354e5 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1722 microversion: 2.20 time: 0.161855 Oct 30 00:58:59.864707 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 462/904] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:58:59 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:59:00.892735 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-71b7823c-af47-4833-a13b-c599360d5ae7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:59:00.894142 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-71b7823c-af47-4833-a13b-c599360d5ae7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:59:00.903140 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-71b7823c-af47-4833-a13b-c599360d5ae7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:00.904281 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-71b7823c-af47-4833-a13b-c599360d5ae7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:00.904730 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-71b7823c-af47-4833-a13b-c599360d5ae7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:00.905445 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-71b7823c-af47-4833-a13b-c599360d5ae7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:00.906079 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-71b7823c-af47-4833-a13b-c599360d5ae7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:00.906518 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-71b7823c-af47-4833-a13b-c599360d5ae7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:01.124653 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-71b7823c-af47-4833-a13b-c599360d5ae7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:59:01.143898 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-71b7823c-af47-4833-a13b-c599360d5ae7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:59:01.145371 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-71b7823c-af47-4833-a13b-c599360d5ae7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:59:01.147041 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-71b7823c-af47-4833-a13b-c599360d5ae7 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1722 microversion: 2.20 time: 0.259935 Oct 30 00:59:01.156864 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 443/905] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:59:00 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:59:02.182052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7ee29f6f-a59b-47f7-b5a0-be59dfb57fe3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:59:02.184026 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-7ee29f6f-a59b-47f7-b5a0-be59dfb57fe3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:59:02.197085 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7ee29f6f-a59b-47f7-b5a0-be59dfb57fe3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:02.197818 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7ee29f6f-a59b-47f7-b5a0-be59dfb57fe3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:02.198554 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7ee29f6f-a59b-47f7-b5a0-be59dfb57fe3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:02.199414 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7ee29f6f-a59b-47f7-b5a0-be59dfb57fe3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:02.200332 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7ee29f6f-a59b-47f7-b5a0-be59dfb57fe3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:02.201127 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7ee29f6f-a59b-47f7-b5a0-be59dfb57fe3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:02.288922 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-8624a1d5-8ebc-46c9-915b-6f4960ca0adc req-1aa2df5b-e886-4d4c-8b7a-b5e5b8848fad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f745c72f-1429-408f-bbf6-9d254529e9b3", "name": "network-vif-deleted", "tag": "d3536290-43b6-4818-9024-5c42427edf8f"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:59:02.305589 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-8624a1d5-8ebc-46c9-915b-6f4960ca0adc req-1aa2df5b-e886-4d4c-8b7a-b5e5b8848fad service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:02.306303 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-8624a1d5-8ebc-46c9-915b-6f4960ca0adc req-1aa2df5b-e886-4d4c-8b7a-b5e5b8848fad service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:02.306909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-8624a1d5-8ebc-46c9-915b-6f4960ca0adc req-1aa2df5b-e886-4d4c-8b7a-b5e5b8848fad service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:02.325798 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-8624a1d5-8ebc-46c9-915b-6f4960ca0adc req-1aa2df5b-e886-4d4c-8b7a-b5e5b8848fad service nova] Creating event network-vif-deleted:d3536290-43b6-4818-9024-5c42427edf8f for instance f745c72f-1429-408f-bbf6-9d254529e9b3 on hv-cinder-86149 Oct 30 00:59:02.335927 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-8624a1d5-8ebc-46c9-915b-6f4960ca0adc req-1aa2df5b-e886-4d4c-8b7a-b5e5b8848fad service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051411 Oct 30 00:59:02.340832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 444/906] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 00:59:02.351576 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7ee29f6f-a59b-47f7-b5a0-be59dfb57fe3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:59:02.376913 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7ee29f6f-a59b-47f7-b5a0-be59dfb57fe3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:59:02.391075 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7ee29f6f-a59b-47f7-b5a0-be59dfb57fe3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df1ee15eb3bc468188a9d8c1af46529c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3b2aeb0e094f539e4affd66ea66272', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:59:02.397236 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7ee29f6f-a59b-47f7-b5a0-be59dfb57fe3 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 200 len: 1656 microversion: 2.20 time: 0.225833 Oct 30 00:59:02.418574 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 463/907] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:59:02 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 1656 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 30 00:59:03.432697 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-bd60c2e2-c385-4d3a-843e-2e8224637765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:59:03.433386 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-bd60c2e2-c385-4d3a-843e-2e8224637765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:59:03.445542 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bd60c2e2-c385-4d3a-843e-2e8224637765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:03.446282 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bd60c2e2-c385-4d3a-843e-2e8224637765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:03.446911 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bd60c2e2-c385-4d3a-843e-2e8224637765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:03.447772 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bd60c2e2-c385-4d3a-843e-2e8224637765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:03.448419 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bd60c2e2-c385-4d3a-843e-2e8224637765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:03.448985 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bd60c2e2-c385-4d3a-843e-2e8224637765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:03.474185 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-bd60c2e2-c385-4d3a-843e-2e8224637765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] HTTP exception thrown: Instance f745c72f-1429-408f-bbf6-9d254529e9b3 could not be found. Oct 30 00:59:03.479891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-bd60c2e2-c385-4d3a-843e-2e8224637765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Request method failure captured: Oct 30 00:59:03.479891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 HTTP/1.1 Oct 30 00:59:03.479891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 00:59:03.479891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 00:59:03.479891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 00:59:03.479891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 00:59:03.479891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 00:59:03.479891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 00:59:03.479891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 00:59:03.479891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 00:59:03.479891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXcnPoHIxSE33JzVLE1p0UnANGXki84SKooQwYN6Zvvs7aW6C3LrS3JMJsnEts_GAjUa8Wv9wtzvQkJaP43dRYygck_ynDNpbXhjRjWoDek5RsBi3WZSRrrC6hGNyFjx2l_482fUj5ys0_JHdNfGIu5PI6zdsZzyRIlUkMliHrKgorvg Oct 30 00:59:03.479891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 00:59:03.479891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 00:59:03.479891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 00:59:03.479891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 00:59:03.479891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Openstack-Nova-Api-Version: 2.20 Oct 30 00:59:03.479891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 00:59:03.479891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 00:59:03.479891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: 0f3b2aeb0e094f539e4affd66ea66272 Oct 30 00:59:03.479891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-660388917 Oct 30 00:59:03.479891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 00:59:03.479891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 00:59:03.481544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:59:03.481544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-AttachVolumeShelveTestJSON-660388917 Oct 30 00:59:03.481544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: 0f3b2aeb0e094f539e4affd66ea66272 Oct 30 00:59:03.481544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-660388917 Oct 30 00:59:03.481544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-AttachVolumeShelveTestJSON-660388917-project Oct 30 00:59:03.481544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 00:59:03.481544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 00:59:03.481544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: df1ee15eb3bc468188a9d8c1af46529c Oct 30 00:59:03.481544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-AttachVolumeShelveTestJSON-660388917-project Oct 30 00:59:03.481544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: > Oct 30 00:59:03.481544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Instance f745c72f-1429-408f-bbf6-9d254529e9b3 could not be found. Oct 30 00:59:03.481544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': 'f745c72f-1429-408f-bbf6-9d254529e9b3'} Oct 30 00:59:03.482437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:59:03.482437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:59:03.482437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:59:03.482437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:59:03.482437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:59:03.482437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:59:03.482437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:59:03.482437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:59:03.482437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:59:03.482437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:59:03.482437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f745c72f-1429-408f-bbf6-9d254529e9b3 could not be found. Oct 30 00:59:03.482437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:59:03.482437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:59:03.482437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:59:03.482437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:59:03.482437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:59:03.482437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:59:03.482437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:59:03.482437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:59:03.482437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:59:03.483857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:59:03.483857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 00:59:03.483857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 00:59:03.483857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:59:03.483857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:59:03.483857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:59:03.483857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:59:03.483857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f745c72f-1429-408f-bbf6-9d254529e9b3 could not be found. Oct 30 00:59:03.483857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:59:03.483857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:59:03.483857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:59:03.483857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:59:03.483857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:59:03.483857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:59:03.483857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:59:03.483857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:59:03.483857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f745c72f-1429-408f-bbf6-9d254529e9b3 could not be found. Oct 30 00:59:03.483857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:59:03.486568 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-bd60c2e2-c385-4d3a-843e-2e8224637765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Returning 404 to user: Instance f745c72f-1429-408f-bbf6-9d254529e9b3 could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:59:03.487629 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-bd60c2e2-c385-4d3a-843e-2e8224637765 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 404 len: 111 microversion: 2.20 time: 0.059903 Oct 30 00:59:03.488434 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 445/908] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:59:03 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 00:59:03.498605 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7a0df7ce-800c-463d-b90c-a7834939c716 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '.version_select at 0x7faf75757310>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:59:03.539051 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7a0df7ce-800c-463d-b90c-a7834939c716 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1042805863" status: 204 len: 0 microversion: 2.20 time: 0.045101 Oct 30 00:59:03.541712 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 464/909] 10.222.0.36 () {60 vars in 1262 bytes} [Sun Oct 30 00:59:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1042805863 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 30 00:59:04.694035 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c28b3992-8864-4f19-992f-7b1bb99484cb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Action: 'create', calling method: .version_select at 0x7faf75b228b0>, body: {"keypair": {"name": "tempest-keypair-1523845397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0q28TBV5+F+Jt4C5yMqXMOnpLP1YqBQsiJQDlS8jqWZJ6yJjo9ssagv1VrTAYLlj4J0wZS/kDckB1fnJUCoerYlPUrDU6qg2PQrNcYEAWZPcvpzt1/co3+rIZS9cachw=="}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:59:04.714508 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-c28b3992-8864-4f19-992f-7b1bb99484cb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Getting quotas for project dc70ef555fc84a51b3521007d00b77e3. Resources: {'key_pairs'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 00:59:04.719044 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-c28b3992-8864-4f19-992f-7b1bb99484cb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Getting quotas for user 7353722ccb7548a6b92c89d4917fefaa and project dc70ef555fc84a51b3521007d00b77e3. Resources: {'key_pairs'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 00:59:04.744706 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c28b3992-8864-4f19-992f-7b1bb99484cb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.190215 Oct 30 00:59:04.745558 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 446/910] 10.222.0.36 () {60 vars in 1159 bytes} [Sun Oct 30 00:59:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:59:05.543397 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-1aac50c4-bd22-4edf-b528-68de1da938b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:59:05.544548 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-1aac50c4-bd22-4edf-b528-68de1da938b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:59:05.553051 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1aac50c4-bd22-4edf-b528-68de1da938b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:05.553974 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1aac50c4-bd22-4edf-b528-68de1da938b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:05.554605 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1aac50c4-bd22-4edf-b528-68de1da938b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:05.555591 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1aac50c4-bd22-4edf-b528-68de1da938b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:05.556041 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1aac50c4-bd22-4edf-b528-68de1da938b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:05.556503 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1aac50c4-bd22-4edf-b528-68de1da938b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:05.572129 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-1aac50c4-bd22-4edf-b528-68de1da938b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] HTTP exception thrown: Instance f745c72f-1429-408f-bbf6-9d254529e9b3 could not be found. Oct 30 00:59:05.573697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-1aac50c4-bd22-4edf-b528-68de1da938b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Request method failure captured: Oct 30 00:59:05.573697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: DELETE /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 HTTP/1.1 Oct 30 00:59:05.573697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 00:59:05.573697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 00:59:05.573697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 00:59:05.573697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 00:59:05.573697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 00:59:05.573697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 00:59:05.573697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 00:59:05.573697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 00:59:05.573697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcnPoHIxSE33JzVLE1p0UnANGXki84SKooQwYN6Zvvs7aW6C3LrS3JMJsnEts_GAjUa8Wv9wtzvQkJaP43dRYygck_ynDNpbXhjRjWoDek5RsBi3WZSRrrC6hGNyFjx2l_482fUj5ys0_JHdNfGIu5PI6zdsZzyRIlUkMliHrKgorvg Oct 30 00:59:05.573697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 00:59:05.573697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 00:59:05.573697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 00:59:05.573697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 00:59:05.573697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Openstack-Nova-Api-Version: 2.20 Oct 30 00:59:05.573697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 00:59:05.573697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 00:59:05.573697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: 0f3b2aeb0e094f539e4affd66ea66272 Oct 30 00:59:05.573697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-660388917 Oct 30 00:59:05.573697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 00:59:05.573697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 00:59:05.575314 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:59:05.575314 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-AttachVolumeShelveTestJSON-660388917 Oct 30 00:59:05.575314 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: 0f3b2aeb0e094f539e4affd66ea66272 Oct 30 00:59:05.575314 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-660388917 Oct 30 00:59:05.575314 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-AttachVolumeShelveTestJSON-660388917-project Oct 30 00:59:05.575314 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 00:59:05.575314 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 00:59:05.575314 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: df1ee15eb3bc468188a9d8c1af46529c Oct 30 00:59:05.575314 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-AttachVolumeShelveTestJSON-660388917-project Oct 30 00:59:05.575314 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 00:59:05.575314 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Instance f745c72f-1429-408f-bbf6-9d254529e9b3 could not be found. Oct 30 00:59:05.575314 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': 'f745c72f-1429-408f-bbf6-9d254529e9b3'} Oct 30 00:59:05.576150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:59:05.576150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:59:05.576150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:59:05.576150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:59:05.576150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:59:05.576150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:59:05.576150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:59:05.576150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:59:05.576150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:59:05.576150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:59:05.576150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f745c72f-1429-408f-bbf6-9d254529e9b3 could not be found. Oct 30 00:59:05.576150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:59:05.576150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:59:05.576150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:59:05.576150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:59:05.576150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:59:05.576150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:59:05.576150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:59:05.576150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:59:05.576150 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:59:05.577428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:59:05.577428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 00:59:05.577428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 00:59:05.577428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 00:59:05.577428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 00:59:05.577428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:59:05.577428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:59:05.577428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:59:05.577428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:59:05.577428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f745c72f-1429-408f-bbf6-9d254529e9b3 could not be found. Oct 30 00:59:05.577428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:59:05.577428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:59:05.577428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:59:05.577428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:59:05.577428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:59:05.577428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:59:05.577428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:59:05.577428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:59:05.577428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f745c72f-1429-408f-bbf6-9d254529e9b3 could not be found. Oct 30 00:59:05.577428 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 00:59:05.578652 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-1aac50c4-bd22-4edf-b528-68de1da938b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Returning 404 to user: Instance f745c72f-1429-408f-bbf6-9d254529e9b3 could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:59:05.578652 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-1aac50c4-bd22-4edf-b528-68de1da938b4 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 404 len: 111 microversion: 2.20 time: 0.035769 Oct 30 00:59:05.578652 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 465/911] 10.222.0.36 () {60 vars in 1280 bytes} [Sun Oct 30 00:59:05 2022] DELETE /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 30 00:59:05.585052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1846d43a-6b87-4e00-b9d3-961e00aae5e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:59:05.585663 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1846d43a-6b87-4e00-b9d3-961e00aae5e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: f745c72f-1429-408f-bbf6-9d254529e9b3] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:59:05.591993 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1846d43a-6b87-4e00-b9d3-961e00aae5e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:05.592660 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1846d43a-6b87-4e00-b9d3-961e00aae5e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:05.593103 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1846d43a-6b87-4e00-b9d3-961e00aae5e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:05.593794 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1846d43a-6b87-4e00-b9d3-961e00aae5e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:05.594247 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1846d43a-6b87-4e00-b9d3-961e00aae5e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:05.594858 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1846d43a-6b87-4e00-b9d3-961e00aae5e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:05.609330 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-1846d43a-6b87-4e00-b9d3-961e00aae5e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] HTTP exception thrown: Instance f745c72f-1429-408f-bbf6-9d254529e9b3 could not be found. Oct 30 00:59:05.610914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1846d43a-6b87-4e00-b9d3-961e00aae5e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Request method failure captured: Oct 30 00:59:05.610914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 HTTP/1.1 Oct 30 00:59:05.610914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 00:59:05.610914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 00:59:05.610914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 00:59:05.610914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 00:59:05.610914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 00:59:05.610914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 00:59:05.610914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 00:59:05.610914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 00:59:05.610914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXcnPoHIxSE33JzVLE1p0UnANGXki84SKooQwYN6Zvvs7aW6C3LrS3JMJsnEts_GAjUa8Wv9wtzvQkJaP43dRYygck_ynDNpbXhjRjWoDek5RsBi3WZSRrrC6hGNyFjx2l_482fUj5ys0_JHdNfGIu5PI6zdsZzyRIlUkMliHrKgorvg Oct 30 00:59:05.610914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 00:59:05.610914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 00:59:05.610914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 00:59:05.610914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 00:59:05.610914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Openstack-Nova-Api-Version: 2.20 Oct 30 00:59:05.610914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 00:59:05.610914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 00:59:05.610914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: 0f3b2aeb0e094f539e4affd66ea66272 Oct 30 00:59:05.610914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-660388917 Oct 30 00:59:05.610914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 00:59:05.610914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 00:59:05.612624 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:59:05.612624 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-AttachVolumeShelveTestJSON-660388917 Oct 30 00:59:05.612624 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: 0f3b2aeb0e094f539e4affd66ea66272 Oct 30 00:59:05.612624 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-660388917 Oct 30 00:59:05.612624 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-AttachVolumeShelveTestJSON-660388917-project Oct 30 00:59:05.612624 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 00:59:05.612624 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 00:59:05.612624 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: df1ee15eb3bc468188a9d8c1af46529c Oct 30 00:59:05.612624 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-AttachVolumeShelveTestJSON-660388917-project Oct 30 00:59:05.612624 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: > Oct 30 00:59:05.612624 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Instance f745c72f-1429-408f-bbf6-9d254529e9b3 could not be found. Oct 30 00:59:05.612624 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': 'f745c72f-1429-408f-bbf6-9d254529e9b3'} Oct 30 00:59:05.613393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:59:05.613393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:59:05.613393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:59:05.613393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:59:05.613393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:59:05.613393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:59:05.613393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:59:05.613393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:59:05.613393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:59:05.613393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:59:05.613393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f745c72f-1429-408f-bbf6-9d254529e9b3 could not be found. Oct 30 00:59:05.613393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:59:05.613393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:59:05.613393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:59:05.613393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:59:05.613393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:59:05.613393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:59:05.613393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:59:05.613393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:59:05.613393 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:59:05.614816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:59:05.614816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 00:59:05.614816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 00:59:05.614816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:59:05.614816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:59:05.614816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:59:05.614816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:59:05.614816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f745c72f-1429-408f-bbf6-9d254529e9b3 could not be found. Oct 30 00:59:05.614816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:59:05.614816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:59:05.614816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:59:05.614816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:59:05.614816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:59:05.614816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:59:05.614816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:59:05.614816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:59:05.614816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f745c72f-1429-408f-bbf6-9d254529e9b3 could not be found. Oct 30 00:59:05.614816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:59:05.615929 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1846d43a-6b87-4e00-b9d3-961e00aae5e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Returning 404 to user: Instance f745c72f-1429-408f-bbf6-9d254529e9b3 could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:59:05.615929 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1846d43a-6b87-4e00-b9d3-961e00aae5e6 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3" status: 404 len: 111 microversion: 2.20 time: 0.032419 Oct 30 00:59:05.615929 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 447/912] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:59:05 2022] GET /compute/v2.1/servers/f745c72f-1429-408f-bbf6-9d254529e9b3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 00:59:06.366129 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4ca0096c-1c92-4909-b296-5e6681103357 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-93386632", "imageRef": "27983dee-4bd6-4aad-9c28-22bd5382709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c4c02ee-d590-4828-8332-2711b92b38f9"}], "security_groups": [{"name": "tempest-securitygroup--164476738"}], "key_name": "tempest-keypair-1523845397", "user_data": "}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:59:06.479731 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.network.neutron [None req-4ca0096c-1c92-4909-b296-5e6681103357 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] validate_networks() for [('8c4c02ee-d590-4828-8332-2711b92b38f9', None, None, None, None, None)] {{(pid=125554) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 00:59:06.773639 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-727d1dcf-4b73-4c53-aa58-cc6ef8446642 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:59:06.774142 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-727d1dcf-4b73-4c53-aa58-cc6ef8446642 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:59:06.780761 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-727d1dcf-4b73-4c53-aa58-cc6ef8446642 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:06.781255 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-727d1dcf-4b73-4c53-aa58-cc6ef8446642 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:06.781693 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-727d1dcf-4b73-4c53-aa58-cc6ef8446642 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:06.782403 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-727d1dcf-4b73-4c53-aa58-cc6ef8446642 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:06.782860 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-727d1dcf-4b73-4c53-aa58-cc6ef8446642 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:06.784104 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-727d1dcf-4b73-4c53-aa58-cc6ef8446642 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:06.800357 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-727d1dcf-4b73-4c53-aa58-cc6ef8446642 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] HTTP exception thrown: Instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 could not be found. Oct 30 00:59:06.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-727d1dcf-4b73-4c53-aa58-cc6ef8446642 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Request method failure captured: Oct 30 00:59:06.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: DELETE /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 HTTP/1.1 Oct 30 00:59:06.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 00:59:06.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 00:59:06.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 00:59:06.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 00:59:06.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 00:59:06.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 00:59:06.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 00:59:06.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 00:59:06.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXcnPoHIxSE33JzVLE1p0UnANGXki84SKooQwYN6Zvvs7aW6C3LrS3JMJsnEts_GAjUa8Wv9wtzvQkJaP43dRYygck_ynDNpbXhjRjWoDek5RsBi3WZSRrrC6hGNyFjx2l_482fUj5ys0_JHdNfGIu5PI6zdsZzyRIlUkMliHrKgorvg Oct 30 00:59:06.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 00:59:06.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 00:59:06.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 00:59:06.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 00:59:06.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Openstack-Nova-Api-Version: 2.20 Oct 30 00:59:06.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 00:59:06.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 00:59:06.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: 0f3b2aeb0e094f539e4affd66ea66272 Oct 30 00:59:06.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-660388917 Oct 30 00:59:06.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 00:59:06.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 00:59:06.805316 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:59:06.805316 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-AttachVolumeShelveTestJSON-660388917 Oct 30 00:59:06.805316 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: 0f3b2aeb0e094f539e4affd66ea66272 Oct 30 00:59:06.805316 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-660388917 Oct 30 00:59:06.805316 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-AttachVolumeShelveTestJSON-660388917-project Oct 30 00:59:06.805316 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 00:59:06.805316 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 00:59:06.805316 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: df1ee15eb3bc468188a9d8c1af46529c Oct 30 00:59:06.805316 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-AttachVolumeShelveTestJSON-660388917-project Oct 30 00:59:06.805316 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: > Oct 30 00:59:06.805316 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 could not be found. Oct 30 00:59:06.805316 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': '00747eb3-1c2b-40b2-8e0a-9c440529e833'} Oct 30 00:59:06.806122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:59:06.806122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:59:06.806122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:59:06.806122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:59:06.806122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:59:06.806122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:59:06.806122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:59:06.806122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:59:06.806122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:59:06.806122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:59:06.806122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 could not be found. Oct 30 00:59:06.806122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:59:06.806122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:59:06.806122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:59:06.806122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:59:06.806122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:59:06.806122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:59:06.806122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:59:06.806122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:59:06.806122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:59:06.808490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:59:06.808490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 00:59:06.808490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 00:59:06.808490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 00:59:06.808490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 00:59:06.808490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:59:06.808490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:59:06.808490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:59:06.808490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:59:06.808490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 could not be found. Oct 30 00:59:06.808490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:59:06.808490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:59:06.808490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:59:06.808490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:59:06.808490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:59:06.808490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:59:06.808490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:59:06.808490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:59:06.808490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 could not be found. Oct 30 00:59:06.808490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:59:06.810253 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-727d1dcf-4b73-4c53-aa58-cc6ef8446642 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Returning 404 to user: Instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:59:06.810253 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-727d1dcf-4b73-4c53-aa58-cc6ef8446642 tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 404 len: 111 microversion: 2.20 time: 0.034520 Oct 30 00:59:06.810253 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 448/913] 10.222.0.36 () {60 vars in 1280 bytes} [Sun Oct 30 00:59:06 2022] DELETE /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 30 00:59:06.812311 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-0f36ec78-23ec-4aa5-9f89-91f4947c82cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:59:06.812949 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-0f36ec78-23ec-4aa5-9f89-91f4947c82cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] [instance: 00747eb3-1c2b-40b2-8e0a-9c440529e833] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:59:06.820337 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0f36ec78-23ec-4aa5-9f89-91f4947c82cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:06.820917 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0f36ec78-23ec-4aa5-9f89-91f4947c82cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:06.821407 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0f36ec78-23ec-4aa5-9f89-91f4947c82cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:06.822237 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0f36ec78-23ec-4aa5-9f89-91f4947c82cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:06.822763 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0f36ec78-23ec-4aa5-9f89-91f4947c82cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:06.823258 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0f36ec78-23ec-4aa5-9f89-91f4947c82cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:06.838397 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-0f36ec78-23ec-4aa5-9f89-91f4947c82cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] HTTP exception thrown: Instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 could not be found. Oct 30 00:59:06.839947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-0f36ec78-23ec-4aa5-9f89-91f4947c82cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Request method failure captured: Oct 30 00:59:06.839947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 HTTP/1.1 Oct 30 00:59:06.839947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 00:59:06.839947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 00:59:06.839947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 00:59:06.839947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 00:59:06.839947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 00:59:06.839947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 00:59:06.839947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 00:59:06.839947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 00:59:06.839947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXcnPoHIxSE33JzVLE1p0UnANGXki84SKooQwYN6Zvvs7aW6C3LrS3JMJsnEts_GAjUa8Wv9wtzvQkJaP43dRYygck_ynDNpbXhjRjWoDek5RsBi3WZSRrrC6hGNyFjx2l_482fUj5ys0_JHdNfGIu5PI6zdsZzyRIlUkMliHrKgorvg Oct 30 00:59:06.839947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 00:59:06.839947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 00:59:06.839947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 00:59:06.839947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 00:59:06.839947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Openstack-Nova-Api-Version: 2.20 Oct 30 00:59:06.839947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 00:59:06.839947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 00:59:06.839947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: 0f3b2aeb0e094f539e4affd66ea66272 Oct 30 00:59:06.839947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-660388917 Oct 30 00:59:06.839947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 00:59:06.839947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 00:59:06.841912 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/0f3b2aeb0e094f539e4affd66ea66272"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 00:59:06.841912 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-AttachVolumeShelveTestJSON-660388917 Oct 30 00:59:06.841912 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: 0f3b2aeb0e094f539e4affd66ea66272 Oct 30 00:59:06.841912 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-660388917 Oct 30 00:59:06.841912 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-AttachVolumeShelveTestJSON-660388917-project Oct 30 00:59:06.841912 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 00:59:06.841912 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 00:59:06.841912 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: df1ee15eb3bc468188a9d8c1af46529c Oct 30 00:59:06.841912 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-AttachVolumeShelveTestJSON-660388917-project Oct 30 00:59:06.841912 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: > Oct 30 00:59:06.841912 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 could not be found. Oct 30 00:59:06.841912 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': '00747eb3-1c2b-40b2-8e0a-9c440529e833'} Oct 30 00:59:06.842718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 00:59:06.842718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:59:06.842718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 00:59:06.842718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 00:59:06.842718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 00:59:06.842718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 00:59:06.842718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 00:59:06.842718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 00:59:06.842718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 00:59:06.842718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 00:59:06.842718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 could not be found. Oct 30 00:59:06.842718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:59:06.842718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:59:06.842718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:59:06.842718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:59:06.842718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:59:06.842718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:59:06.842718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 00:59:06.842718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 00:59:06.842718 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 00:59:06.844353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 00:59:06.844353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 00:59:06.844353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 00:59:06.844353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 00:59:06.844353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 00:59:06.844353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 00:59:06.844353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 00:59:06.844353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 could not be found. Oct 30 00:59:06.844353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:59:06.844353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 00:59:06.844353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:59:06.844353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 00:59:06.844353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 00:59:06.844353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 00:59:06.844353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 00:59:06.844353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 00:59:06.844353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 could not be found. Oct 30 00:59:06.844353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 00:59:06.846436 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-0f36ec78-23ec-4aa5-9f89-91f4947c82cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] Returning 404 to user: Instance 00747eb3-1c2b-40b2-8e0a-9c440529e833 could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 00:59:06.846436 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-0f36ec78-23ec-4aa5-9f89-91f4947c82cf tempest-AttachVolumeShelveTestJSON-660388917 tempest-AttachVolumeShelveTestJSON-660388917-project] 10.222.0.36 "GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833" status: 404 len: 111 microversion: 2.20 time: 0.033285 Oct 30 00:59:06.846436 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 449/914] 10.222.0.36 () {60 vars in 1277 bytes} [Sun Oct 30 00:59:06 2022] GET /compute/v2.1/servers/00747eb3-1c2b-40b2-8e0a-9c440529e833 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 30 00:59:07.026744 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-4ca0096c-1c92-4909-b296-5e6681103357 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Flavor limits 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 00:59:07.027223 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-4ca0096c-1c92-4909-b296-5e6681103357 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Image limits 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 00:59:07.027609 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-4ca0096c-1c92-4909-b296-5e6681103357 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Flavor pref 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 00:59:07.028009 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-4ca0096c-1c92-4909-b296-5e6681103357 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Image pref 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 00:59:07.028437 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-4ca0096c-1c92-4909-b296-5e6681103357 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 00:59:07.039887 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4ca0096c-1c92-4909-b296-5e6681103357 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:07.040498 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4ca0096c-1c92-4909-b296-5e6681103357 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:07.040999 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4ca0096c-1c92-4909-b296-5e6681103357 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:07.042286 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4ca0096c-1c92-4909-b296-5e6681103357 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:07.042844 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4ca0096c-1c92-4909-b296-5e6681103357 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:07.043336 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4ca0096c-1c92-4909-b296-5e6681103357 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:07.063052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-4ca0096c-1c92-4909-b296-5e6681103357 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Getting quotas for project dc70ef555fc84a51b3521007d00b77e3. Resources: {'instances', 'cores', 'ram'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 00:59:07.067630 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-4ca0096c-1c92-4909-b296-5e6681103357 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Getting quotas for user 7353722ccb7548a6b92c89d4917fefaa and project dc70ef555fc84a51b3521007d00b77e3. Resources: {'instances', 'cores', 'ram'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 00:59:07.080151 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-4ca0096c-1c92-4909-b296-5e6681103357 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Going to run 1 instances... {{(pid=125554) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 00:59:07.082772 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-4ca0096c-1c92-4909-b296-5e6681103357 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27983dee-4bd6-4aad-9c28-22bd5382709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125554) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 00:59:07.146553 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-4ca0096c-1c92-4909-b296-5e6681103357 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.785282 Oct 30 00:59:07.147518 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 466/915] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Oct 30 00:59:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 00:59:07.158463 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-cb6643b9-e51c-4a36-a98f-94b9a19e0bdb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:59:07.159080 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-cb6643b9-e51c-4a36-a98f-94b9a19e0bdb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:59:07.234433 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-cb6643b9-e51c-4a36-a98f-94b9a19e0bdb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:59:07.251152 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-cb6643b9-e51c-4a36-a98f-94b9a19e0bdb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33" status: 200 len: 1240 microversion: 2.1 time: 0.096425 Oct 30 00:59:07.258326 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 450/916] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:59:07 2022] GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33 => generated 1240 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:59:08.281359 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-404e026b-79e1-4142-9078-ac6a013f2a95 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:59:08.284892 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-404e026b-79e1-4142-9078-ac6a013f2a95 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:59:08.294179 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-404e026b-79e1-4142-9078-ac6a013f2a95 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:08.295074 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-404e026b-79e1-4142-9078-ac6a013f2a95 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:08.295734 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-404e026b-79e1-4142-9078-ac6a013f2a95 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:08.296733 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-404e026b-79e1-4142-9078-ac6a013f2a95 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:08.297411 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-404e026b-79e1-4142-9078-ac6a013f2a95 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:08.298050 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-404e026b-79e1-4142-9078-ac6a013f2a95 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:08.383406 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-404e026b-79e1-4142-9078-ac6a013f2a95 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:59:08.393293 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-404e026b-79e1-4142-9078-ac6a013f2a95 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33" status: 200 len: 1292 microversion: 2.1 time: 0.117177 Oct 30 00:59:08.394327 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 467/917] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:59:08 2022] GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33 => generated 1292 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:59:09.437924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3aab21b6-5e5f-4643-bd3a-a0478a126348 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:59:09.441391 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-3aab21b6-5e5f-4643-bd3a-a0478a126348 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:59:09.454583 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3aab21b6-5e5f-4643-bd3a-a0478a126348 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:09.456712 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3aab21b6-5e5f-4643-bd3a-a0478a126348 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:09.459112 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3aab21b6-5e5f-4643-bd3a-a0478a126348 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:09.460200 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3aab21b6-5e5f-4643-bd3a-a0478a126348 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:09.461006 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3aab21b6-5e5f-4643-bd3a-a0478a126348 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:09.462666 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3aab21b6-5e5f-4643-bd3a-a0478a126348 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:09.550099 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3aab21b6-5e5f-4643-bd3a-a0478a126348 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:59:09.561225 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-3aab21b6-5e5f-4643-bd3a-a0478a126348 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33" status: 200 len: 1298 microversion: 2.1 time: 0.142515 Oct 30 00:59:09.562279 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 451/918] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:59:09 2022] GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33 => generated 1298 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:59:10.586678 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ca13fd6d-f125-4533-a935-db7d41012908 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:59:10.587402 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ca13fd6d-f125-4533-a935-db7d41012908 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:59:10.595921 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca13fd6d-f125-4533-a935-db7d41012908 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:10.596682 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca13fd6d-f125-4533-a935-db7d41012908 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:10.597409 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca13fd6d-f125-4533-a935-db7d41012908 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:10.598263 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca13fd6d-f125-4533-a935-db7d41012908 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:10.599477 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca13fd6d-f125-4533-a935-db7d41012908 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:10.600383 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca13fd6d-f125-4533-a935-db7d41012908 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:10.813846 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ca13fd6d-f125-4533-a935-db7d41012908 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:59:10.823135 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ca13fd6d-f125-4533-a935-db7d41012908 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33" status: 200 len: 1365 microversion: 2.1 time: 0.241907 Oct 30 00:59:10.824341 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 468/919] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:59:10 2022] GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:59:11.025155 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-19e4ff99-f12b-4d0c-a2f6-83790a470050 req-20c56b44-edc2-4931-b945-a7feb499a66a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcef108b-3362-4ede-8646-9b25d0cd5d33", "tag": "0fb4edbc-706f-4257-b3e5-11d481fd7dc2"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:59:11.045105 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-19e4ff99-f12b-4d0c-a2f6-83790a470050 req-20c56b44-edc2-4931-b945-a7feb499a66a service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:11.045838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-19e4ff99-f12b-4d0c-a2f6-83790a470050 req-20c56b44-edc2-4931-b945-a7feb499a66a service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:11.046504 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-19e4ff99-f12b-4d0c-a2f6-83790a470050 req-20c56b44-edc2-4931-b945-a7feb499a66a service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:11.065338 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-19e4ff99-f12b-4d0c-a2f6-83790a470050 req-20c56b44-edc2-4931-b945-a7feb499a66a service nova] Creating event network-changed:0fb4edbc-706f-4257-b3e5-11d481fd7dc2 for instance fcef108b-3362-4ede-8646-9b25d0cd5d33 on hv-cinder-86149 Oct 30 00:59:11.078033 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-19e4ff99-f12b-4d0c-a2f6-83790a470050 req-20c56b44-edc2-4931-b945-a7feb499a66a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058950 Oct 30 00:59:11.080994 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 452/920] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 00:59:11.848251 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2ac15ce1-5c35-4b21-bbf9-0fe2b9112449 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:59:11.849869 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2ac15ce1-5c35-4b21-bbf9-0fe2b9112449 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:59:11.858939 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ac15ce1-5c35-4b21-bbf9-0fe2b9112449 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:11.859419 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ac15ce1-5c35-4b21-bbf9-0fe2b9112449 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:11.859921 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ac15ce1-5c35-4b21-bbf9-0fe2b9112449 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:11.860638 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ac15ce1-5c35-4b21-bbf9-0fe2b9112449 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:11.861083 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ac15ce1-5c35-4b21-bbf9-0fe2b9112449 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:11.861498 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ac15ce1-5c35-4b21-bbf9-0fe2b9112449 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:11.998329 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2ac15ce1-5c35-4b21-bbf9-0fe2b9112449 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:59:12.007293 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2ac15ce1-5c35-4b21-bbf9-0fe2b9112449 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33" status: 200 len: 1365 microversion: 2.1 time: 0.163794 Oct 30 00:59:12.007939 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 469/921] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:59:11 2022] GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:59:13.030930 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-25c6ffcc-941b-4f5e-b103-6c1f11d32146 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:59:13.031636 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-25c6ffcc-941b-4f5e-b103-6c1f11d32146 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:59:13.038311 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-25c6ffcc-941b-4f5e-b103-6c1f11d32146 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:13.038793 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-25c6ffcc-941b-4f5e-b103-6c1f11d32146 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:13.039226 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-25c6ffcc-941b-4f5e-b103-6c1f11d32146 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:13.039945 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-25c6ffcc-941b-4f5e-b103-6c1f11d32146 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:13.040471 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-25c6ffcc-941b-4f5e-b103-6c1f11d32146 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:13.041018 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-25c6ffcc-941b-4f5e-b103-6c1f11d32146 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:13.184387 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-25c6ffcc-941b-4f5e-b103-6c1f11d32146 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:59:13.192240 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-25c6ffcc-941b-4f5e-b103-6c1f11d32146 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33" status: 200 len: 1365 microversion: 2.1 time: 0.165356 Oct 30 00:59:13.193744 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 453/922] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:59:13 2022] GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:59:14.217258 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-0e7384c1-27a0-4a5e-b6b9-63b04a42fa58 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:59:14.217858 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-0e7384c1-27a0-4a5e-b6b9-63b04a42fa58 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:59:14.223778 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0e7384c1-27a0-4a5e-b6b9-63b04a42fa58 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:14.224965 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0e7384c1-27a0-4a5e-b6b9-63b04a42fa58 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:14.225399 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0e7384c1-27a0-4a5e-b6b9-63b04a42fa58 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:14.226093 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0e7384c1-27a0-4a5e-b6b9-63b04a42fa58 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:14.226540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0e7384c1-27a0-4a5e-b6b9-63b04a42fa58 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:14.226956 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0e7384c1-27a0-4a5e-b6b9-63b04a42fa58 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:14.425749 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-0e7384c1-27a0-4a5e-b6b9-63b04a42fa58 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:59:14.433918 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-0e7384c1-27a0-4a5e-b6b9-63b04a42fa58 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33" status: 200 len: 1365 microversion: 2.1 time: 0.221032 Oct 30 00:59:14.434478 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 470/923] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:59:14 2022] GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:59:15.458232 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-8e1ed7e3-2acb-434a-875c-9c6a45a4d75a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:59:15.459243 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-8e1ed7e3-2acb-434a-875c-9c6a45a4d75a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:59:15.465279 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8e1ed7e3-2acb-434a-875c-9c6a45a4d75a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:15.465848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8e1ed7e3-2acb-434a-875c-9c6a45a4d75a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:15.466270 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8e1ed7e3-2acb-434a-875c-9c6a45a4d75a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:15.467215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8e1ed7e3-2acb-434a-875c-9c6a45a4d75a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:15.467659 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8e1ed7e3-2acb-434a-875c-9c6a45a4d75a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:15.468077 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8e1ed7e3-2acb-434a-875c-9c6a45a4d75a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:15.606483 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8e1ed7e3-2acb-434a-875c-9c6a45a4d75a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:59:15.614348 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-8e1ed7e3-2acb-434a-875c-9c6a45a4d75a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33" status: 200 len: 1365 microversion: 2.1 time: 0.160053 Oct 30 00:59:15.616074 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 454/924] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:59:15 2022] GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:59:16.638672 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-951ea1f5-c1fd-41aa-9668-6d4077683a45 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:59:16.639280 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-951ea1f5-c1fd-41aa-9668-6d4077683a45 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:59:16.645822 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-951ea1f5-c1fd-41aa-9668-6d4077683a45 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:16.646801 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-951ea1f5-c1fd-41aa-9668-6d4077683a45 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:16.647240 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-951ea1f5-c1fd-41aa-9668-6d4077683a45 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:16.647934 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-951ea1f5-c1fd-41aa-9668-6d4077683a45 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:16.648413 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-951ea1f5-c1fd-41aa-9668-6d4077683a45 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:16.648836 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-951ea1f5-c1fd-41aa-9668-6d4077683a45 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:16.773947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-caa4ac14-e073-485f-b881-759ecf60b923 req-f9230cd9-66a8-47f0-9cc2-ad1b0175eac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcef108b-3362-4ede-8646-9b25d0cd5d33", "name": "network-vif-plugged", "status": "completed", "tag": "0fb4edbc-706f-4257-b3e5-11d481fd7dc2"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:59:16.784927 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-caa4ac14-e073-485f-b881-759ecf60b923 req-f9230cd9-66a8-47f0-9cc2-ad1b0175eac5 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:16.785735 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-caa4ac14-e073-485f-b881-759ecf60b923 req-f9230cd9-66a8-47f0-9cc2-ad1b0175eac5 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:16.786079 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-caa4ac14-e073-485f-b881-759ecf60b923 req-f9230cd9-66a8-47f0-9cc2-ad1b0175eac5 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:16.791406 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-951ea1f5-c1fd-41aa-9668-6d4077683a45 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:59:16.798512 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-caa4ac14-e073-485f-b881-759ecf60b923 req-f9230cd9-66a8-47f0-9cc2-ad1b0175eac5 service nova] Creating event network-vif-plugged:0fb4edbc-706f-4257-b3e5-11d481fd7dc2 for instance fcef108b-3362-4ede-8646-9b25d0cd5d33 on hv-cinder-86149 Oct 30 00:59:16.800294 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-951ea1f5-c1fd-41aa-9668-6d4077683a45 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33" status: 200 len: 1365 microversion: 2.1 time: 0.165376 Oct 30 00:59:16.809508 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 471/925] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:59:16 2022] GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:59:16.818741 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-caa4ac14-e073-485f-b881-759ecf60b923 req-f9230cd9-66a8-47f0-9cc2-ad1b0175eac5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047976 Oct 30 00:59:16.819472 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 455/926] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 00:59:17.823345 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-44e390e0-5cb4-472f-847e-262f73eff33a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:59:17.824034 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-44e390e0-5cb4-472f-847e-262f73eff33a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:59:17.825872 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=2 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:59:17.826533 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=6 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:59:17.832964 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-44e390e0-5cb4-472f-847e-262f73eff33a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:17.833664 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-44e390e0-5cb4-472f-847e-262f73eff33a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:17.834101 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-44e390e0-5cb4-472f-847e-262f73eff33a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:17.834801 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-44e390e0-5cb4-472f-847e-262f73eff33a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:17.835261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-44e390e0-5cb4-472f-847e-262f73eff33a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:17.836372 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-44e390e0-5cb4-472f-847e-262f73eff33a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:17.972941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-44e390e0-5cb4-472f-847e-262f73eff33a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:59:17.981606 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-44e390e0-5cb4-472f-847e-262f73eff33a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33" status: 200 len: 1365 microversion: 2.1 time: 0.162731 Oct 30 00:59:17.982180 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 472/927] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:59:17 2022] GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:59:19.002225 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=6 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 00:59:19.006837 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f127196f-ecea-4ff8-9118-009e77eb6d72 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:59:19.008110 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f127196f-ecea-4ff8-9118-009e77eb6d72 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:59:19.014532 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f127196f-ecea-4ff8-9118-009e77eb6d72 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:19.015006 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f127196f-ecea-4ff8-9118-009e77eb6d72 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:19.015435 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f127196f-ecea-4ff8-9118-009e77eb6d72 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:19.016133 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f127196f-ecea-4ff8-9118-009e77eb6d72 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:19.016583 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f127196f-ecea-4ff8-9118-009e77eb6d72 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:19.017001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f127196f-ecea-4ff8-9118-009e77eb6d72 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:19.146514 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f127196f-ecea-4ff8-9118-009e77eb6d72 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 00:59:19.154883 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f127196f-ecea-4ff8-9118-009e77eb6d72 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33" status: 200 len: 1556 microversion: 2.1 time: 0.153588 Oct 30 00:59:19.155445 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 456/928] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 00:59:18 2022] GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 00:59:19.177527 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-3196ab31-a7ac-4ab2-b780-ccf0a44c54ed tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 00:59:19.178020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-3196ab31-a7ac-4ab2-b780-ccf0a44c54ed tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 00:59:19.184452 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3196ab31-a7ac-4ab2-b780-ccf0a44c54ed tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:19.184930 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3196ab31-a7ac-4ab2-b780-ccf0a44c54ed tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:19.185366 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3196ab31-a7ac-4ab2-b780-ccf0a44c54ed tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:19.186055 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3196ab31-a7ac-4ab2-b780-ccf0a44c54ed tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:19.186507 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3196ab31-a7ac-4ab2-b780-ccf0a44c54ed tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:19.186928 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-3196ab31-a7ac-4ab2-b780-ccf0a44c54ed tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:19.272311 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-3196ab31-a7ac-4ab2-b780-ccf0a44c54ed tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098370 Oct 30 00:59:19.281021 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 473/929] 10.222.0.36 () {58 vars in 1275 bytes} [Sun Oct 30 00:59:19 2022] GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 00:59:20.389622 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-57fb3b01-56c5-4ad6-95f4-f0880801ade5 req-e79ad661-acb5-46e3-a7c0-bb1edb23cad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcef108b-3362-4ede-8646-9b25d0cd5d33", "tag": "0fb4edbc-706f-4257-b3e5-11d481fd7dc2"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 00:59:20.401483 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-57fb3b01-56c5-4ad6-95f4-f0880801ade5 req-e79ad661-acb5-46e3-a7c0-bb1edb23cad7 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 00:59:20.402029 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-57fb3b01-56c5-4ad6-95f4-f0880801ade5 req-e79ad661-acb5-46e3-a7c0-bb1edb23cad7 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 00:59:20.402523 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-57fb3b01-56c5-4ad6-95f4-f0880801ade5 req-e79ad661-acb5-46e3-a7c0-bb1edb23cad7 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 00:59:20.413660 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-57fb3b01-56c5-4ad6-95f4-f0880801ade5 req-e79ad661-acb5-46e3-a7c0-bb1edb23cad7 service nova] Creating event network-changed:0fb4edbc-706f-4257-b3e5-11d481fd7dc2 for instance fcef108b-3362-4ede-8646-9b25d0cd5d33 on hv-cinder-86149 Oct 30 00:59:20.419274 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-57fb3b01-56c5-4ad6-95f4-f0880801ade5 req-e79ad661-acb5-46e3-a7c0-bb1edb23cad7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034340 Oct 30 00:59:20.419955 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 457/930] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 00:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:00:18.690138 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:00:18.691402 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=63 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:00:18.879857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-8dfdc909-98f1-4434-a81d-fab4e97b10c7 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Action: 'create', calling method: .version_select at 0x7faf79235700>, body: {"keypair": {"name": "tempest-TestShelveInstance-486884272", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgt5k3GWJK73qwV8X4JBABkr2vum6C+QotRXvOFJTY8asdBl8OZSBIaDz6mQBSMJgQrcNzy3gtXGLKTvFaaggisPmFwTiatmOn2iXh5kJSd5PRPUArK6CL77zXdRH3RHA=="}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:00:18.896956 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-8dfdc909-98f1-4434-a81d-fab4e97b10c7 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Getting quotas for project fede7ffbdd1d4ed8bbc37b55e03e4791. Resources: {'key_pairs'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:00:18.901158 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-8dfdc909-98f1-4434-a81d-fab4e97b10c7 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Getting quotas for user b8a999d19a634bcfb26d2d936b3429bc and project fede7ffbdd1d4ed8bbc37b55e03e4791. Resources: {'key_pairs'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:00:18.924450 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-8dfdc909-98f1-4434-a81d-fab4e97b10c7 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.236650 Oct 30 01:00:18.925266 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 474/931] 10.222.0.36 () {60 vars in 1159 bytes} [Sun Oct 30 01:00:18 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:00:40.499723 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:00:40.500480 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:00:40.501753 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 30 01:00:40.501899 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Sun Oct 30 01:00:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.36) !!! Oct 30 01:00:40.508619 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-55617f20-2a91-4341-8783-fd423787134e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-704589120", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-486884272", "security_groups": [{"name": "tempest-secgroup-smoke-1128808731"}], "networks": [{"uuid": "bf382215-2ad9-476a-a282-4c5d1edb6d79"}], "block_device_mapping_v2": [{"uuid": "4197c3cf-7c96-49ee-adf4-fb736ece041f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:00:40.624591 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.network.neutron [None req-55617f20-2a91-4341-8783-fd423787134e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] validate_networks() for [('bf382215-2ad9-476a-a282-4c5d1edb6d79', None, None, None, None, None)] {{(pid=125553) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:00:41.081790 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-55617f20-2a91-4341-8783-fd423787134e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Flavor limits 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:00:41.082237 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-55617f20-2a91-4341-8783-fd423787134e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Image limits 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:00:41.082817 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-55617f20-2a91-4341-8783-fd423787134e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Flavor pref 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:00:41.083224 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-55617f20-2a91-4341-8783-fd423787134e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Image pref 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:00:41.083668 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-55617f20-2a91-4341-8783-fd423787134e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:00:41.092269 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-55617f20-2a91-4341-8783-fd423787134e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:41.092764 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-55617f20-2a91-4341-8783-fd423787134e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:41.093188 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-55617f20-2a91-4341-8783-fd423787134e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:41.093900 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-55617f20-2a91-4341-8783-fd423787134e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:41.094345 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-55617f20-2a91-4341-8783-fd423787134e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:41.094759 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-55617f20-2a91-4341-8783-fd423787134e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:41.113143 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-55617f20-2a91-4341-8783-fd423787134e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Getting quotas for project fede7ffbdd1d4ed8bbc37b55e03e4791. Resources: {'instances', 'cores', 'ram'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:00:41.117031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-55617f20-2a91-4341-8783-fd423787134e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Getting quotas for user b8a999d19a634bcfb26d2d936b3429bc and project fede7ffbdd1d4ed8bbc37b55e03e4791. Resources: {'instances', 'cores', 'ram'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:00:41.173071 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-55617f20-2a91-4341-8783-fd423787134e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Going to run 1 instances... {{(pid=125553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:00:41.175599 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-55617f20-2a91-4341-8783-fd423787134e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4197c3cf-7c96-49ee-adf4-fb736ece041f',volume_size=None,volume_type=None)] {{(pid=125553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:00:41.307543 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-55617f20-2a91-4341-8783-fd423787134e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.809835 Oct 30 01:00:41.308204 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 458/932] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Oct 30 01:00:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:00:41.319785 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-9011e9e7-50f8-4d58-be8e-d138e95b8d27 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:00:41.320408 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-9011e9e7-50f8-4d58-be8e-d138e95b8d27 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:00:41.325202 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=4 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:00:41.326306 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:00:41.386387 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9011e9e7-50f8-4d58-be8e-d138e95b8d27 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:00:41.393825 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-9011e9e7-50f8-4d58-be8e-d138e95b8d27 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1087 microversion: 2.1 time: 0.077834 Oct 30 01:00:41.394730 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 475/933] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:00:41 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1087 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:00:42.417472 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f607faff-2210-40f3-b306-fe538d9d500a tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:00:42.418068 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f607faff-2210-40f3-b306-fe538d9d500a tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:00:42.425955 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f607faff-2210-40f3-b306-fe538d9d500a tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:42.426445 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f607faff-2210-40f3-b306-fe538d9d500a tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:42.426874 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f607faff-2210-40f3-b306-fe538d9d500a tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:42.427577 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f607faff-2210-40f3-b306-fe538d9d500a tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:42.428026 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f607faff-2210-40f3-b306-fe538d9d500a tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:42.428470 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f607faff-2210-40f3-b306-fe538d9d500a tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:42.498776 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f607faff-2210-40f3-b306-fe538d9d500a tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:00:42.507232 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f607faff-2210-40f3-b306-fe538d9d500a tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1193 microversion: 2.1 time: 0.094070 Oct 30 01:00:42.513027 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 459/934] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:00:42 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1193 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:00:43.530924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-6e3dfaa8-d841-4cd8-9655-b3f385f58639 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:00:43.531519 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-6e3dfaa8-d841-4cd8-9655-b3f385f58639 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:00:43.538662 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6e3dfaa8-d841-4cd8-9655-b3f385f58639 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:43.539450 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6e3dfaa8-d841-4cd8-9655-b3f385f58639 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:43.539959 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6e3dfaa8-d841-4cd8-9655-b3f385f58639 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:43.540753 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6e3dfaa8-d841-4cd8-9655-b3f385f58639 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:43.541282 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6e3dfaa8-d841-4cd8-9655-b3f385f58639 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:43.541779 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6e3dfaa8-d841-4cd8-9655-b3f385f58639 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:43.673809 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6e3dfaa8-d841-4cd8-9655-b3f385f58639 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:00:43.682183 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-6e3dfaa8-d841-4cd8-9655-b3f385f58639 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1259 microversion: 2.1 time: 0.155219 Oct 30 01:00:43.682752 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 476/935] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:00:43 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:00:43.906034 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-96537f26-78c3-43dc-a7b2-7cf806afd37e req-66204505-9b8e-4302-bc20-028aa8c55ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f441dbc7-8369-4779-a326-78cbd6e9bc9d", "tag": "f3e3ac4b-534c-4019-98ab-6faab24ef915"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:00:43.915742 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-96537f26-78c3-43dc-a7b2-7cf806afd37e req-66204505-9b8e-4302-bc20-028aa8c55ab6 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:43.916250 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-96537f26-78c3-43dc-a7b2-7cf806afd37e req-66204505-9b8e-4302-bc20-028aa8c55ab6 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:43.916676 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-96537f26-78c3-43dc-a7b2-7cf806afd37e req-66204505-9b8e-4302-bc20-028aa8c55ab6 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:43.928627 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-96537f26-78c3-43dc-a7b2-7cf806afd37e req-66204505-9b8e-4302-bc20-028aa8c55ab6 service nova] Creating event network-changed:f3e3ac4b-534c-4019-98ab-6faab24ef915 for instance f441dbc7-8369-4779-a326-78cbd6e9bc9d on hv-cinder-86149 Oct 30 01:00:43.933675 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-96537f26-78c3-43dc-a7b2-7cf806afd37e req-66204505-9b8e-4302-bc20-028aa8c55ab6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108674 Oct 30 01:00:43.934249 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 460/936] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:00:44.705946 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2934975c-fd7f-4350-8b07-fdc21e800ce5 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:00:44.706554 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2934975c-fd7f-4350-8b07-fdc21e800ce5 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:00:44.713468 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2934975c-fd7f-4350-8b07-fdc21e800ce5 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:44.713945 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2934975c-fd7f-4350-8b07-fdc21e800ce5 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:44.714373 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2934975c-fd7f-4350-8b07-fdc21e800ce5 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:44.715058 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2934975c-fd7f-4350-8b07-fdc21e800ce5 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:44.715507 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2934975c-fd7f-4350-8b07-fdc21e800ce5 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:44.715926 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2934975c-fd7f-4350-8b07-fdc21e800ce5 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:44.846734 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2934975c-fd7f-4350-8b07-fdc21e800ce5 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:00:44.855370 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2934975c-fd7f-4350-8b07-fdc21e800ce5 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1259 microversion: 2.1 time: 0.153253 Oct 30 01:00:44.855916 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 477/937] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:00:44 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:00:45.879415 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c8e4cee8-3441-4075-87b3-6b76edf38786 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:00:45.880131 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-c8e4cee8-3441-4075-87b3-6b76edf38786 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:00:45.886720 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c8e4cee8-3441-4075-87b3-6b76edf38786 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:45.887190 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c8e4cee8-3441-4075-87b3-6b76edf38786 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:45.887614 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c8e4cee8-3441-4075-87b3-6b76edf38786 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:45.888395 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c8e4cee8-3441-4075-87b3-6b76edf38786 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:45.888850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c8e4cee8-3441-4075-87b3-6b76edf38786 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:45.889263 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c8e4cee8-3441-4075-87b3-6b76edf38786 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:46.018447 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c8e4cee8-3441-4075-87b3-6b76edf38786 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:00:46.026590 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c8e4cee8-3441-4075-87b3-6b76edf38786 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1259 microversion: 2.1 time: 0.152027 Oct 30 01:00:46.027139 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 461/938] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:00:45 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:00:47.050075 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-386550fc-0ed3-40d4-a4c5-72411d6f2ddd tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:00:47.050672 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-386550fc-0ed3-40d4-a4c5-72411d6f2ddd tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:00:47.057663 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-386550fc-0ed3-40d4-a4c5-72411d6f2ddd tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:47.058134 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-386550fc-0ed3-40d4-a4c5-72411d6f2ddd tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:47.058560 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-386550fc-0ed3-40d4-a4c5-72411d6f2ddd tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:47.059238 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-386550fc-0ed3-40d4-a4c5-72411d6f2ddd tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:47.059688 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-386550fc-0ed3-40d4-a4c5-72411d6f2ddd tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:47.060121 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-386550fc-0ed3-40d4-a4c5-72411d6f2ddd tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:47.187323 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-386550fc-0ed3-40d4-a4c5-72411d6f2ddd tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:00:47.195550 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-386550fc-0ed3-40d4-a4c5-72411d6f2ddd tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1259 microversion: 2.1 time: 0.149356 Oct 30 01:00:47.196106 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 478/939] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:00:47 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:00:48.217606 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-fbb48b3c-ccec-4696-bd50-6565e55c77c8 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:00:48.218244 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-fbb48b3c-ccec-4696-bd50-6565e55c77c8 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:00:48.225654 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbb48b3c-ccec-4696-bd50-6565e55c77c8 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:48.226132 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbb48b3c-ccec-4696-bd50-6565e55c77c8 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:48.226558 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbb48b3c-ccec-4696-bd50-6565e55c77c8 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:48.227239 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbb48b3c-ccec-4696-bd50-6565e55c77c8 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:48.227687 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbb48b3c-ccec-4696-bd50-6565e55c77c8 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:48.228125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-fbb48b3c-ccec-4696-bd50-6565e55c77c8 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:48.359590 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-fbb48b3c-ccec-4696-bd50-6565e55c77c8 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:00:48.367715 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-fbb48b3c-ccec-4696-bd50-6565e55c77c8 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1259 microversion: 2.1 time: 0.153960 Oct 30 01:00:48.368369 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 462/940] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:00:48 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:00:49.390707 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-53fba55a-3987-4dae-8d8d-566eac75a09e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:00:49.391345 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-53fba55a-3987-4dae-8d8d-566eac75a09e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:00:49.397726 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-53fba55a-3987-4dae-8d8d-566eac75a09e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:49.398208 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-53fba55a-3987-4dae-8d8d-566eac75a09e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:49.398644 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-53fba55a-3987-4dae-8d8d-566eac75a09e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:49.399340 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-53fba55a-3987-4dae-8d8d-566eac75a09e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:49.399793 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-53fba55a-3987-4dae-8d8d-566eac75a09e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:49.400243 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-53fba55a-3987-4dae-8d8d-566eac75a09e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:49.529212 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-53fba55a-3987-4dae-8d8d-566eac75a09e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:00:49.536893 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-53fba55a-3987-4dae-8d8d-566eac75a09e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1259 microversion: 2.1 time: 0.150055 Oct 30 01:00:49.537503 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 479/941] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:00:49 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:00:50.185915 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-cf756f0f-9b86-4126-bc0d-f0054b2aeb66 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:00:50.186451 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-cf756f0f-9b86-4126-bc0d-f0054b2aeb66 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:00:50.192763 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cf756f0f-9b86-4126-bc0d-f0054b2aeb66 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:50.193262 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cf756f0f-9b86-4126-bc0d-f0054b2aeb66 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:50.193695 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cf756f0f-9b86-4126-bc0d-f0054b2aeb66 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:50.194377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cf756f0f-9b86-4126-bc0d-f0054b2aeb66 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:50.194823 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cf756f0f-9b86-4126-bc0d-f0054b2aeb66 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:50.195238 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cf756f0f-9b86-4126-bc0d-f0054b2aeb66 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:50.217996 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-cf756f0f-9b86-4126-bc0d-f0054b2aeb66 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33/ips" status: 200 len: 151 microversion: 2.1 time: 0.036077 Oct 30 01:00:50.218539 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 463/942] 10.222.0.36 () {58 vars in 1248 bytes} [Sun Oct 30 01:00:50 2022] GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:00:50.558895 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-1cda48c8-808e-48bf-9be6-9bf49f9eab31 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:00:50.559498 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-1cda48c8-808e-48bf-9be6-9bf49f9eab31 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:00:50.566235 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1cda48c8-808e-48bf-9be6-9bf49f9eab31 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:50.566757 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1cda48c8-808e-48bf-9be6-9bf49f9eab31 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:50.567211 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1cda48c8-808e-48bf-9be6-9bf49f9eab31 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:50.567951 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1cda48c8-808e-48bf-9be6-9bf49f9eab31 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:50.568465 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1cda48c8-808e-48bf-9be6-9bf49f9eab31 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:50.568883 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1cda48c8-808e-48bf-9be6-9bf49f9eab31 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:50.701700 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-1cda48c8-808e-48bf-9be6-9bf49f9eab31 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:00:50.710468 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-1cda48c8-808e-48bf-9be6-9bf49f9eab31 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1259 microversion: 2.1 time: 0.154367 Oct 30 01:00:50.711025 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 480/943] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:00:50 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:00:51.591108 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-7eb88454-b8c9-4843-a7b8-2fe9bdf04448 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a56ccb6-4f95-4c54-8d07-0fab55a136b8"}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:00:51.593610 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-7eb88454-b8c9-4843-a7b8-2fe9bdf04448 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:00:51.595587 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=2 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:00:51.596275 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=6 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:00:51.604620 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7eb88454-b8c9-4843-a7b8-2fe9bdf04448 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:51.605102 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7eb88454-b8c9-4843-a7b8-2fe9bdf04448 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:51.605531 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7eb88454-b8c9-4843-a7b8-2fe9bdf04448 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:51.606226 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7eb88454-b8c9-4843-a7b8-2fe9bdf04448 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:51.606686 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7eb88454-b8c9-4843-a7b8-2fe9bdf04448 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:51.607105 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7eb88454-b8c9-4843-a7b8-2fe9bdf04448 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:51.734167 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ddb9c0c0-5e2d-4573-a972-876d858e94fc tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:00:51.734926 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ddb9c0c0-5e2d-4573-a972-876d858e94fc tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:00:51.737760 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=2 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:00:51.743379 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ddb9c0c0-5e2d-4573-a972-876d858e94fc tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:51.743863 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ddb9c0c0-5e2d-4573-a972-876d858e94fc tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:51.744528 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ddb9c0c0-5e2d-4573-a972-876d858e94fc tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:51.745413 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ddb9c0c0-5e2d-4573-a972-876d858e94fc tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:51.745865 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ddb9c0c0-5e2d-4573-a972-876d858e94fc tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:51.746284 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ddb9c0c0-5e2d-4573-a972-876d858e94fc tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:51.889618 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ddb9c0c0-5e2d-4573-a972-876d858e94fc tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:00:51.891105 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-7eb88454-b8c9-4843-a7b8-2fe9bdf04448 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "POST /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303737 Oct 30 01:00:51.891940 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 464/944] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Oct 30 01:00:51 2022] POST /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:00:51.898350 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ddb9c0c0-5e2d-4573-a972-876d858e94fc tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1259 microversion: 2.1 time: 0.168335 Oct 30 01:00:51.899015 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 481/945] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:00:51 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:00:52.922549 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-ae1b942b-b200-4e37-a20f-0a4052401039 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:00:52.923248 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-ae1b942b-b200-4e37-a20f-0a4052401039 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:00:52.930759 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ae1b942b-b200-4e37-a20f-0a4052401039 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:52.931242 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ae1b942b-b200-4e37-a20f-0a4052401039 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:52.931678 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ae1b942b-b200-4e37-a20f-0a4052401039 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:52.932408 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ae1b942b-b200-4e37-a20f-0a4052401039 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:52.932861 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ae1b942b-b200-4e37-a20f-0a4052401039 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:52.933284 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ae1b942b-b200-4e37-a20f-0a4052401039 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:53.069221 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ae1b942b-b200-4e37-a20f-0a4052401039 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:00:53.076958 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-ae1b942b-b200-4e37-a20f-0a4052401039 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1259 microversion: 2.1 time: 0.158609 Oct 30 01:00:53.077605 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 465/946] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:00:52 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:00:54.100811 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b331e724-8b33-4462-80fa-246326bf8df1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:00:54.101418 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-b331e724-8b33-4462-80fa-246326bf8df1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:00:54.107737 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b331e724-8b33-4462-80fa-246326bf8df1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:54.108253 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b331e724-8b33-4462-80fa-246326bf8df1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:54.108693 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b331e724-8b33-4462-80fa-246326bf8df1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:54.109377 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b331e724-8b33-4462-80fa-246326bf8df1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:54.109830 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b331e724-8b33-4462-80fa-246326bf8df1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:54.110252 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b331e724-8b33-4462-80fa-246326bf8df1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:54.238967 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b331e724-8b33-4462-80fa-246326bf8df1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:00:54.246625 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b331e724-8b33-4462-80fa-246326bf8df1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1259 microversion: 2.1 time: 0.150603 Oct 30 01:00:54.247176 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 482/947] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:00:54 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:00:55.275860 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ab9fb196-2994-4ae2-84f9-461f21743a39 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:00:55.277346 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ab9fb196-2994-4ae2-84f9-461f21743a39 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:00:55.284531 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ab9fb196-2994-4ae2-84f9-461f21743a39 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:55.285357 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ab9fb196-2994-4ae2-84f9-461f21743a39 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:55.285875 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ab9fb196-2994-4ae2-84f9-461f21743a39 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:55.286732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ab9fb196-2994-4ae2-84f9-461f21743a39 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:55.287311 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ab9fb196-2994-4ae2-84f9-461f21743a39 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:55.288210 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ab9fb196-2994-4ae2-84f9-461f21743a39 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:55.293595 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-b4d47e18-5cc9-46b1-9fbb-e301b7e5f320 req-6cf95918-6c7e-4252-9768-b0adfdacc72f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f441dbc7-8369-4779-a326-78cbd6e9bc9d", "name": "network-vif-plugged", "status": "completed", "tag": "f3e3ac4b-534c-4019-98ab-6faab24ef915"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:00:55.304345 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-b4d47e18-5cc9-46b1-9fbb-e301b7e5f320 req-6cf95918-6c7e-4252-9768-b0adfdacc72f service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:55.305014 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-b4d47e18-5cc9-46b1-9fbb-e301b7e5f320 req-6cf95918-6c7e-4252-9768-b0adfdacc72f service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:55.305348 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-b4d47e18-5cc9-46b1-9fbb-e301b7e5f320 req-6cf95918-6c7e-4252-9768-b0adfdacc72f service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:55.316829 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-b4d47e18-5cc9-46b1-9fbb-e301b7e5f320 req-6cf95918-6c7e-4252-9768-b0adfdacc72f service nova] Creating event network-vif-plugged:f3e3ac4b-534c-4019-98ab-6faab24ef915 for instance f441dbc7-8369-4779-a326-78cbd6e9bc9d on hv-cinder-86149 Oct 30 01:00:55.322562 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-b4d47e18-5cc9-46b1-9fbb-e301b7e5f320 req-6cf95918-6c7e-4252-9768-b0adfdacc72f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091825 Oct 30 01:00:55.323160 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 466/948] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:00:55.430330 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ab9fb196-2994-4ae2-84f9-461f21743a39 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:00:55.438101 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ab9fb196-2994-4ae2-84f9-461f21743a39 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1259 microversion: 2.1 time: 0.167233 Oct 30 01:00:55.438650 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 483/949] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:00:55 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:00:56.463375 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f5106511-4813-46b3-8935-aae7d25a3f5b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:00:56.463983 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f5106511-4813-46b3-8935-aae7d25a3f5b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:00:56.471660 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f5106511-4813-46b3-8935-aae7d25a3f5b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:56.472168 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f5106511-4813-46b3-8935-aae7d25a3f5b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:56.472602 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f5106511-4813-46b3-8935-aae7d25a3f5b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:56.473283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f5106511-4813-46b3-8935-aae7d25a3f5b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:56.473985 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f5106511-4813-46b3-8935-aae7d25a3f5b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:56.474412 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f5106511-4813-46b3-8935-aae7d25a3f5b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:56.611237 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f5106511-4813-46b3-8935-aae7d25a3f5b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:00:56.618905 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f5106511-4813-46b3-8935-aae7d25a3f5b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1259 microversion: 2.1 time: 0.160353 Oct 30 01:00:56.619459 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 467/950] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:00:56 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:00:57.642302 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-29929b0e-d3bd-4ffd-9ea4-eb3b876f1591 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:00:57.642850 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-29929b0e-d3bd-4ffd-9ea4-eb3b876f1591 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:00:57.649400 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-29929b0e-d3bd-4ffd-9ea4-eb3b876f1591 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:57.649878 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-29929b0e-d3bd-4ffd-9ea4-eb3b876f1591 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:57.650307 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-29929b0e-d3bd-4ffd-9ea4-eb3b876f1591 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:57.650988 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-29929b0e-d3bd-4ffd-9ea4-eb3b876f1591 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:57.651435 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-29929b0e-d3bd-4ffd-9ea4-eb3b876f1591 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:57.651850 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-29929b0e-d3bd-4ffd-9ea4-eb3b876f1591 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:57.780632 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-29929b0e-d3bd-4ffd-9ea4-eb3b876f1591 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:00:57.789274 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-29929b0e-d3bd-4ffd-9ea4-eb3b876f1591 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1440 microversion: 2.1 time: 0.150869 Oct 30 01:00:57.789839 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 484/951] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:00:57 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1440 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:00:57.811512 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-da9ed0e8-6faf-4a6d-81ad-d303dbe9f6f9 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:00:57.812258 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-da9ed0e8-6faf-4a6d-81ad-d303dbe9f6f9 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:00:57.818572 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-da9ed0e8-6faf-4a6d-81ad-d303dbe9f6f9 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:57.819214 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-da9ed0e8-6faf-4a6d-81ad-d303dbe9f6f9 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:57.819459 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-da9ed0e8-6faf-4a6d-81ad-d303dbe9f6f9 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:57.820235 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-da9ed0e8-6faf-4a6d-81ad-d303dbe9f6f9 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:57.820706 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-da9ed0e8-6faf-4a6d-81ad-d303dbe9f6f9 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:57.821124 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-da9ed0e8-6faf-4a6d-81ad-d303dbe9f6f9 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:58.173979 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-da9ed0e8-6faf-4a6d-81ad-d303dbe9f6f9 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:00:58.182289 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-da9ed0e8-6faf-4a6d-81ad-d303dbe9f6f9 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1440 microversion: 2.1 time: 0.374620 Oct 30 01:00:58.182841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 468/952] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:00:57 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1440 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:00:59.456502 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-205d112b-7b14-43a7-9a7e-1c78165cbf47 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Action: 'create', calling method: .version_select at 0x7faf792f0c10>, body: {"keypair": {"name": "tempest-keypair-301521525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMvmo2yyasSSinOVqa4k72McT5II4+1JpJ4G4zNqpt0kDmPRT242zgRfI5OqnFaMvSCHMxIJ4QxlbBmF/0yYByKP9jdkrdaWlQHIKgexDUD+WQDpU9OPcSG2iOBmLvNnQ=="}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:00:59.472747 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-205d112b-7b14-43a7-9a7e-1c78165cbf47 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Getting quotas for project dc70ef555fc84a51b3521007d00b77e3. Resources: {'key_pairs'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:00:59.477435 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-205d112b-7b14-43a7-9a7e-1c78165cbf47 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Getting quotas for user 7353722ccb7548a6b92c89d4917fefaa and project dc70ef555fc84a51b3521007d00b77e3. Resources: {'key_pairs'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:00:59.499303 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-205d112b-7b14-43a7-9a7e-1c78165cbf47 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046877 Oct 30 01:00:59.499891 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 485/953] 10.222.0.36 () {60 vars in 1159 bytes} [Sun Oct 30 01:00:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:00:59.908261 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-67f400ef-17bd-49e3-8132-3841982ffd42 req-662d6977-9176-49ec-a8bc-7a6c02b1a8a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f441dbc7-8369-4779-a326-78cbd6e9bc9d", "tag": "f3e3ac4b-534c-4019-98ab-6faab24ef915"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:00:59.922695 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-67f400ef-17bd-49e3-8132-3841982ffd42 req-662d6977-9176-49ec-a8bc-7a6c02b1a8a8 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:00:59.923173 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-67f400ef-17bd-49e3-8132-3841982ffd42 req-662d6977-9176-49ec-a8bc-7a6c02b1a8a8 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:00:59.923601 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-67f400ef-17bd-49e3-8132-3841982ffd42 req-662d6977-9176-49ec-a8bc-7a6c02b1a8a8 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:00:59.935806 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-67f400ef-17bd-49e3-8132-3841982ffd42 req-662d6977-9176-49ec-a8bc-7a6c02b1a8a8 service nova] Creating event network-changed:f3e3ac4b-534c-4019-98ab-6faab24ef915 for instance f441dbc7-8369-4779-a326-78cbd6e9bc9d on hv-cinder-86149 Oct 30 01:00:59.940822 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-67f400ef-17bd-49e3-8132-3841982ffd42 req-662d6977-9176-49ec-a8bc-7a6c02b1a8a8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102574 Oct 30 01:00:59.942079 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 469/954] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:01:01.448036 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2ecbfa04-69ec-4f00-af92-fa3cd1bcaad5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2119769826", "imageRef": "27983dee-4bd6-4aad-9c28-22bd5382709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c4c02ee-d590-4828-8332-2711b92b38f9"}], "security_groups": [{"name": "tempest-securitygroup--2047776668"}], "key_name": "tempest-keypair-301521525", "user_data": "}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:01:01.552149 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.network.neutron [None req-2ecbfa04-69ec-4f00-af92-fa3cd1bcaad5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] validate_networks() for [('8c4c02ee-d590-4828-8332-2711b92b38f9', None, None, None, None, None)] {{(pid=125554) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:01:01.924736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-2ecbfa04-69ec-4f00-af92-fa3cd1bcaad5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Flavor limits 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:01:01.925159 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-2ecbfa04-69ec-4f00-af92-fa3cd1bcaad5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Image limits 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:01:01.925631 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-2ecbfa04-69ec-4f00-af92-fa3cd1bcaad5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Flavor pref 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:01:01.926033 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-2ecbfa04-69ec-4f00-af92-fa3cd1bcaad5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Image pref 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:01:01.926440 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-2ecbfa04-69ec-4f00-af92-fa3cd1bcaad5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:01:01.935716 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ecbfa04-69ec-4f00-af92-fa3cd1bcaad5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:01.936220 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ecbfa04-69ec-4f00-af92-fa3cd1bcaad5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:01.936649 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ecbfa04-69ec-4f00-af92-fa3cd1bcaad5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:01.937367 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ecbfa04-69ec-4f00-af92-fa3cd1bcaad5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:01.937816 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ecbfa04-69ec-4f00-af92-fa3cd1bcaad5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:01.938237 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ecbfa04-69ec-4f00-af92-fa3cd1bcaad5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:01.954342 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-2ecbfa04-69ec-4f00-af92-fa3cd1bcaad5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Getting quotas for project dc70ef555fc84a51b3521007d00b77e3. Resources: {'instances', 'cores', 'ram'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:01:01.957952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-2ecbfa04-69ec-4f00-af92-fa3cd1bcaad5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Getting quotas for user 7353722ccb7548a6b92c89d4917fefaa and project dc70ef555fc84a51b3521007d00b77e3. Resources: {'instances', 'cores', 'ram'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:01:01.968505 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2ecbfa04-69ec-4f00-af92-fa3cd1bcaad5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Going to run 1 instances... {{(pid=125554) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:01:01.970613 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2ecbfa04-69ec-4f00-af92-fa3cd1bcaad5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: ce0e4e1c-608e-4056-9d3b-1451ac41e206] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27983dee-4bd6-4aad-9c28-22bd5382709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125554) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:01:02.022931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2ecbfa04-69ec-4f00-af92-fa3cd1bcaad5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.578897 Oct 30 01:01:02.023562 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 486/955] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Oct 30 01:01:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:01:02.036054 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-4cd99401-c0a1-4243-b122-53eb0653c754 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:01:02.036892 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-4cd99401-c0a1-4243-b122-53eb0653c754 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: ce0e4e1c-608e-4056-9d3b-1451ac41e206] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:01:02.092797 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-4cd99401-c0a1-4243-b122-53eb0653c754 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:01:02.100693 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-4cd99401-c0a1-4243-b122-53eb0653c754 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206" status: 200 len: 1241 microversion: 2.1 time: 0.068783 Oct 30 01:01:02.101344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 470/956] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:01:02 2022] GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:01:03.123866 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-58b2cc6a-d4cf-4bde-ac20-872f13ecee31 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:01:03.124464 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-58b2cc6a-d4cf-4bde-ac20-872f13ecee31 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: ce0e4e1c-608e-4056-9d3b-1451ac41e206] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:01:03.130914 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58b2cc6a-d4cf-4bde-ac20-872f13ecee31 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:03.132055 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58b2cc6a-d4cf-4bde-ac20-872f13ecee31 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:03.132707 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58b2cc6a-d4cf-4bde-ac20-872f13ecee31 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:03.133420 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58b2cc6a-d4cf-4bde-ac20-872f13ecee31 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:03.133878 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58b2cc6a-d4cf-4bde-ac20-872f13ecee31 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:03.134304 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-58b2cc6a-d4cf-4bde-ac20-872f13ecee31 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:03.206690 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-58b2cc6a-d4cf-4bde-ac20-872f13ecee31 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:01:03.216313 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-58b2cc6a-d4cf-4bde-ac20-872f13ecee31 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206" status: 200 len: 1301 microversion: 2.1 time: 0.097180 Oct 30 01:01:03.217032 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 487/957] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:01:03 2022] GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206 => generated 1301 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:01:04.241724 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f79fa32a-d90c-45b7-8330-28ddce3b4ce3 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:01:04.242338 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f79fa32a-d90c-45b7-8330-28ddce3b4ce3 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: ce0e4e1c-608e-4056-9d3b-1451ac41e206] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:01:04.249475 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f79fa32a-d90c-45b7-8330-28ddce3b4ce3 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:04.249956 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f79fa32a-d90c-45b7-8330-28ddce3b4ce3 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:04.250392 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f79fa32a-d90c-45b7-8330-28ddce3b4ce3 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:04.251090 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f79fa32a-d90c-45b7-8330-28ddce3b4ce3 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:04.251543 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f79fa32a-d90c-45b7-8330-28ddce3b4ce3 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:04.251965 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f79fa32a-d90c-45b7-8330-28ddce3b4ce3 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:04.381326 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f79fa32a-d90c-45b7-8330-28ddce3b4ce3 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:01:04.389312 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f79fa32a-d90c-45b7-8330-28ddce3b4ce3 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206" status: 200 len: 1367 microversion: 2.1 time: 0.152148 Oct 30 01:01:04.389880 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 471/958] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:01:04 2022] GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:01:04.639314 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-791bc380-dbd7-49a8-a26b-9877081929fc req-475c109a-d035-4c17-96a0-bd91fa2b5648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce0e4e1c-608e-4056-9d3b-1451ac41e206", "tag": "0b5865e3-6819-4971-a858-edb75563ec2e"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:01:04.650236 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-791bc380-dbd7-49a8-a26b-9877081929fc req-475c109a-d035-4c17-96a0-bd91fa2b5648 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:04.650803 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-791bc380-dbd7-49a8-a26b-9877081929fc req-475c109a-d035-4c17-96a0-bd91fa2b5648 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:04.651318 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-791bc380-dbd7-49a8-a26b-9877081929fc req-475c109a-d035-4c17-96a0-bd91fa2b5648 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:04.662339 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-791bc380-dbd7-49a8-a26b-9877081929fc req-475c109a-d035-4c17-96a0-bd91fa2b5648 service nova] Creating event network-changed:0b5865e3-6819-4971-a858-edb75563ec2e for instance ce0e4e1c-608e-4056-9d3b-1451ac41e206 on hv-cinder-86149 Oct 30 01:01:04.667305 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-791bc380-dbd7-49a8-a26b-9877081929fc req-475c109a-d035-4c17-96a0-bd91fa2b5648 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031729 Oct 30 01:01:04.667890 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 488/959] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:01:05.412438 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c03b2526-f453-4ed7-a6ef-c7cb8511f5e6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:01:05.413331 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-c03b2526-f453-4ed7-a6ef-c7cb8511f5e6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: ce0e4e1c-608e-4056-9d3b-1451ac41e206] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:01:05.419734 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c03b2526-f453-4ed7-a6ef-c7cb8511f5e6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:05.420241 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c03b2526-f453-4ed7-a6ef-c7cb8511f5e6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:05.420670 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c03b2526-f453-4ed7-a6ef-c7cb8511f5e6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:05.421352 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c03b2526-f453-4ed7-a6ef-c7cb8511f5e6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:05.421798 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c03b2526-f453-4ed7-a6ef-c7cb8511f5e6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:05.422231 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c03b2526-f453-4ed7-a6ef-c7cb8511f5e6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:05.556726 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c03b2526-f453-4ed7-a6ef-c7cb8511f5e6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:01:05.564256 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c03b2526-f453-4ed7-a6ef-c7cb8511f5e6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206" status: 200 len: 1367 microversion: 2.1 time: 0.155781 Oct 30 01:01:05.564809 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 472/960] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:01:05 2022] GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:01:06.589501 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-41008195-f3e1-4ca7-bce2-9bbb2bb67fef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:01:06.590194 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-41008195-f3e1-4ca7-bce2-9bbb2bb67fef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: ce0e4e1c-608e-4056-9d3b-1451ac41e206] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:01:06.596305 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-41008195-f3e1-4ca7-bce2-9bbb2bb67fef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:06.596779 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-41008195-f3e1-4ca7-bce2-9bbb2bb67fef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:06.597213 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-41008195-f3e1-4ca7-bce2-9bbb2bb67fef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:06.597898 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-41008195-f3e1-4ca7-bce2-9bbb2bb67fef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:06.598346 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-41008195-f3e1-4ca7-bce2-9bbb2bb67fef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:06.598764 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-41008195-f3e1-4ca7-bce2-9bbb2bb67fef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:06.728898 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-41008195-f3e1-4ca7-bce2-9bbb2bb67fef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:01:06.736515 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-41008195-f3e1-4ca7-bce2-9bbb2bb67fef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206" status: 200 len: 1367 microversion: 2.1 time: 0.152287 Oct 30 01:01:06.737079 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 489/961] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:01:06 2022] GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:01:07.761411 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e4706dde-8d67-404d-81a4-c3da83933d85 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:01:07.762507 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-e4706dde-8d67-404d-81a4-c3da83933d85 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: ce0e4e1c-608e-4056-9d3b-1451ac41e206] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:01:07.770708 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e4706dde-8d67-404d-81a4-c3da83933d85 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:07.771346 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e4706dde-8d67-404d-81a4-c3da83933d85 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:07.771623 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e4706dde-8d67-404d-81a4-c3da83933d85 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:07.772971 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e4706dde-8d67-404d-81a4-c3da83933d85 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:07.773455 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e4706dde-8d67-404d-81a4-c3da83933d85 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:07.773832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e4706dde-8d67-404d-81a4-c3da83933d85 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:07.925885 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-e4706dde-8d67-404d-81a4-c3da83933d85 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:01:07.946121 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e4706dde-8d67-404d-81a4-c3da83933d85 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206" status: 200 len: 1367 microversion: 2.1 time: 0.190613 Oct 30 01:01:07.946685 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 473/962] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:01:07 2022] GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:01:08.969363 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-b32a10d3-1138-435d-adce-51013b269cb8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:01:08.969984 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-b32a10d3-1138-435d-adce-51013b269cb8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: ce0e4e1c-608e-4056-9d3b-1451ac41e206] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:01:08.977539 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b32a10d3-1138-435d-adce-51013b269cb8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:08.978011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b32a10d3-1138-435d-adce-51013b269cb8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:08.978446 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b32a10d3-1138-435d-adce-51013b269cb8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:08.979123 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b32a10d3-1138-435d-adce-51013b269cb8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:08.979568 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b32a10d3-1138-435d-adce-51013b269cb8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:08.979984 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-b32a10d3-1138-435d-adce-51013b269cb8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:09.108385 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-b32a10d3-1138-435d-adce-51013b269cb8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:01:09.116003 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-b32a10d3-1138-435d-adce-51013b269cb8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206" status: 200 len: 1367 microversion: 2.1 time: 0.150446 Oct 30 01:01:09.116755 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 490/963] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:01:08 2022] GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:01:09.340056 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-b9ea24f9-69cc-4f02-bd41-2a476f272d88 req-8643a319-61e6-4014-a0e2-a15f05643d6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0e4e1c-608e-4056-9d3b-1451ac41e206", "name": "network-vif-plugged", "status": "completed", "tag": "0b5865e3-6819-4971-a858-edb75563ec2e"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:01:09.351528 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-b9ea24f9-69cc-4f02-bd41-2a476f272d88 req-8643a319-61e6-4014-a0e2-a15f05643d6d service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:09.352172 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-b9ea24f9-69cc-4f02-bd41-2a476f272d88 req-8643a319-61e6-4014-a0e2-a15f05643d6d service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:09.352606 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-b9ea24f9-69cc-4f02-bd41-2a476f272d88 req-8643a319-61e6-4014-a0e2-a15f05643d6d service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:09.363621 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-b9ea24f9-69cc-4f02-bd41-2a476f272d88 req-8643a319-61e6-4014-a0e2-a15f05643d6d service nova] Creating event network-vif-plugged:0b5865e3-6819-4971-a858-edb75563ec2e for instance ce0e4e1c-608e-4056-9d3b-1451ac41e206 on hv-cinder-86149 Oct 30 01:01:09.368885 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-b9ea24f9-69cc-4f02-bd41-2a476f272d88 req-8643a319-61e6-4014-a0e2-a15f05643d6d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032537 Oct 30 01:01:09.369514 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 474/964] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:01:10.138796 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-9a6f95ff-fc4a-40d1-b4f3-6e9307c6f8d9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:01:10.139336 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-9a6f95ff-fc4a-40d1-b4f3-6e9307c6f8d9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: ce0e4e1c-608e-4056-9d3b-1451ac41e206] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:01:10.145865 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9a6f95ff-fc4a-40d1-b4f3-6e9307c6f8d9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:10.146339 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9a6f95ff-fc4a-40d1-b4f3-6e9307c6f8d9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:10.146769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9a6f95ff-fc4a-40d1-b4f3-6e9307c6f8d9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:10.148208 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9a6f95ff-fc4a-40d1-b4f3-6e9307c6f8d9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:10.148849 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9a6f95ff-fc4a-40d1-b4f3-6e9307c6f8d9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:10.149275 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9a6f95ff-fc4a-40d1-b4f3-6e9307c6f8d9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:10.279808 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9a6f95ff-fc4a-40d1-b4f3-6e9307c6f8d9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:01:10.287362 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-9a6f95ff-fc4a-40d1-b4f3-6e9307c6f8d9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206" status: 200 len: 1367 microversion: 2.1 time: 0.152518 Oct 30 01:01:10.288100 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 491/965] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:01:10 2022] GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:01:11.311036 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c3a787a0-0d00-4b5a-8105-d6d83da44083 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:01:11.311733 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-c3a787a0-0d00-4b5a-8105-d6d83da44083 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: ce0e4e1c-608e-4056-9d3b-1451ac41e206] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:01:11.313669 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:01:11.319846 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c3a787a0-0d00-4b5a-8105-d6d83da44083 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:11.320366 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c3a787a0-0d00-4b5a-8105-d6d83da44083 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:11.320916 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c3a787a0-0d00-4b5a-8105-d6d83da44083 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:11.321618 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c3a787a0-0d00-4b5a-8105-d6d83da44083 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:11.322068 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c3a787a0-0d00-4b5a-8105-d6d83da44083 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:11.322488 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c3a787a0-0d00-4b5a-8105-d6d83da44083 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:11.325608 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:01:11.469999 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c3a787a0-0d00-4b5a-8105-d6d83da44083 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:01:11.478770 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c3a787a0-0d00-4b5a-8105-d6d83da44083 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206" status: 200 len: 1367 microversion: 2.1 time: 0.172362 Oct 30 01:01:11.479335 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 475/966] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:01:11 2022] GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:01:12.502057 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-a97b244c-ecce-4ef4-8956-c8079040b374 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:01:12.502659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-a97b244c-ecce-4ef4-8956-c8079040b374 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: ce0e4e1c-608e-4056-9d3b-1451ac41e206] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:01:12.504601 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=2 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:01:12.505251 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=10 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:01:12.505860 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=4 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:01:12.511960 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a97b244c-ecce-4ef4-8956-c8079040b374 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:12.512466 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a97b244c-ecce-4ef4-8956-c8079040b374 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:12.512896 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a97b244c-ecce-4ef4-8956-c8079040b374 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:12.513577 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a97b244c-ecce-4ef4-8956-c8079040b374 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:12.514020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a97b244c-ecce-4ef4-8956-c8079040b374 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:12.514436 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a97b244c-ecce-4ef4-8956-c8079040b374 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:12.517786 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=83 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:01:12.645231 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-a97b244c-ecce-4ef4-8956-c8079040b374 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:01:12.652851 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-a97b244c-ecce-4ef4-8956-c8079040b374 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206" status: 200 len: 1557 microversion: 2.1 time: 0.154746 Oct 30 01:01:12.653337 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 492/967] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:01:12 2022] GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:01:12.675039 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e225d812-d330-4773-924d-1349b643e16b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:01:12.675555 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-e225d812-d330-4773-924d-1349b643e16b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: ce0e4e1c-608e-4056-9d3b-1451ac41e206] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:01:12.677465 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=2 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:01:12.683752 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e225d812-d330-4773-924d-1349b643e16b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:12.684262 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e225d812-d330-4773-924d-1349b643e16b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:12.684687 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e225d812-d330-4773-924d-1349b643e16b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:12.685370 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e225d812-d330-4773-924d-1349b643e16b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:12.685817 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e225d812-d330-4773-924d-1349b643e16b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:12.686234 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e225d812-d330-4773-924d-1349b643e16b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:12.765538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e225d812-d330-4773-924d-1349b643e16b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094175 Oct 30 01:01:12.766123 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 476/968] 10.222.0.36 () {58 vars in 1275 bytes} [Sun Oct 30 01:01:12 2022] GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:01:13.908938 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-ec4dc69d-64dc-4566-9799-ac237c4c8075 req-f37a7725-8a65-411b-be95-c315cf91d58e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce0e4e1c-608e-4056-9d3b-1451ac41e206", "tag": "0b5865e3-6819-4971-a858-edb75563ec2e"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:01:13.919373 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-ec4dc69d-64dc-4566-9799-ac237c4c8075 req-f37a7725-8a65-411b-be95-c315cf91d58e service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:01:13.919932 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-ec4dc69d-64dc-4566-9799-ac237c4c8075 req-f37a7725-8a65-411b-be95-c315cf91d58e service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:01:13.920468 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-ec4dc69d-64dc-4566-9799-ac237c4c8075 req-f37a7725-8a65-411b-be95-c315cf91d58e service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:01:13.932191 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-ec4dc69d-64dc-4566-9799-ac237c4c8075 req-f37a7725-8a65-411b-be95-c315cf91d58e service nova] Creating event network-changed:0b5865e3-6819-4971-a858-edb75563ec2e for instance ce0e4e1c-608e-4056-9d3b-1451ac41e206 on hv-cinder-86149 Oct 30 01:01:13.937218 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-ec4dc69d-64dc-4566-9799-ac237c4c8075 req-f37a7725-8a65-411b-be95-c315cf91d58e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031953 Oct 30 01:01:13.937802 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 493/969] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:02:28.846889 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=3 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:02:28.847682 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=9 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:02:28.848835 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 01:02:28.848999 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Sun Oct 30 01:02:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206/ips (ip 10.222.0.36) !!! Oct 30 01:02:28.857085 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-8c64d9e0-d4e8-4568-a9fd-839d5f7d7881 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:28.857572 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-8c64d9e0-d4e8-4568-a9fd-839d5f7d7881 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: ce0e4e1c-608e-4056-9d3b-1451ac41e206] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:28.866040 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8c64d9e0-d4e8-4568-a9fd-839d5f7d7881 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:28.866526 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8c64d9e0-d4e8-4568-a9fd-839d5f7d7881 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:28.866961 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8c64d9e0-d4e8-4568-a9fd-839d5f7d7881 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:28.867654 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8c64d9e0-d4e8-4568-a9fd-839d5f7d7881 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:28.868126 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8c64d9e0-d4e8-4568-a9fd-839d5f7d7881 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:28.868559 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8c64d9e0-d4e8-4568-a9fd-839d5f7d7881 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:28.893396 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-8c64d9e0-d4e8-4568-a9fd-839d5f7d7881 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206/ips" status: 200 len: 149 microversion: 2.1 time: 0.048293 Oct 30 01:02:28.893969 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 477/970] 10.222.0.36 () {58 vars in 1248 bytes} [Sun Oct 30 01:02:28 2022] GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:02:28.903615 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=3 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:02:28.904424 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=7 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:02:28.910736 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-373303aa-ad40-46ba-b9c3-cfd106727819 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a56ccb6-4f95-4c54-8d07-0fab55a136b8"}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:02:28.913168 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-373303aa-ad40-46ba-b9c3-cfd106727819 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: ce0e4e1c-608e-4056-9d3b-1451ac41e206] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:28.919971 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-373303aa-ad40-46ba-b9c3-cfd106727819 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:28.920475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-373303aa-ad40-46ba-b9c3-cfd106727819 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:28.920902 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-373303aa-ad40-46ba-b9c3-cfd106727819 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:28.921707 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-373303aa-ad40-46ba-b9c3-cfd106727819 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:28.923287 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-373303aa-ad40-46ba-b9c3-cfd106727819 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:28.923724 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-373303aa-ad40-46ba-b9c3-cfd106727819 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:29.003598 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-373303aa-ad40-46ba-b9c3-cfd106727819 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] HTTP exception thrown: Invalid volume: volume 5a56ccb6-4f95-4c54-8d07-0fab55a136b8 is already attached to instances: fcef108b-3362-4ede-8646-9b25d0cd5d33 Oct 30 01:02:29.005415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-373303aa-ad40-46ba-b9c3-cfd106727819 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Request method failure captured: Oct 30 01:02:29.005415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: POST /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206/os-volume_attachments HTTP/1.1 Oct 30 01:02:29.005415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 01:02:29.005415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 01:02:29.005415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 01:02:29.005415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 74 Oct 30 01:02:29.005415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 01:02:29.005415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 01:02:29.005415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 01:02:29.005415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 01:02:29.005415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcxY8meP6vvhjbMl5SDegLis0GNSJ-as78-NEFrPY5visYG6nAB9FJqsqSnKlmkLjDyOiz2t_9jR7dQbTJVad7Ot58e6fXvOwVA87-vsO9JQuc5io49RaVNBH3eRFW0SDeH6mC7M6KHqZYWVfoplDjyGh6d_VPsrjSppQ78VV6m9NHw Oct 30 01:02:29.005415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 01:02:29.005415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 01:02:29.005415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 01:02:29.005415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 01:02:29.005415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 01:02:29.005415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 01:02:29.005415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:02:29.005415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:02:29.005415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 01:02:29.005415 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 01:02:29.007080 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:02:29.007080 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:02:29.007080 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:02:29.007080 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:02:29.007080 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:02:29.007080 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 01:02:29.007080 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 01:02:29.007080 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 7353722ccb7548a6b92c89d4917fefaa Oct 30 01:02:29.007080 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:02:29.007080 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Oct 30 01:02:29.007080 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {"volumeAttachment": {"volumeId": "5a56ccb6-4f95-4c54-8d07-0fab55a136b8"}} Oct 30 01:02:29.007080 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 01:02:29.008018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Invalid volume: volume 5a56ccb6-4f95-4c54-8d07-0fab55a136b8 is already attached to instances: fcef108b-3362-4ede-8646-9b25d0cd5d33 Oct 30 01:02:29.008018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'server_id': 'ce0e4e1c-608e-4056-9d3b-1451ac41e206', 'body': {'volumeAttachment': {'volumeId': '5a56ccb6-4f95-4c54-8d07-0fab55a136b8'}}} Oct 30 01:02:29.008018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:02:29.008018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:29.008018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 30 01:02:29.008018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 30 01:02:29.008018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:02:29.008018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:02:29.008018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 30 01:02:29.008018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 30 01:02:29.008018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 30 01:02:29.008018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 30 01:02:29.008018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 30 01:02:29.008018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 30 01:02:29.008018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5a56ccb6-4f95-4c54-8d07-0fab55a136b8 is already attached to instances: fcef108b-3362-4ede-8646-9b25d0cd5d33 Oct 30 01:02:29.008018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:02:29.008018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:02:29.008018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:02:29.008018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:29.009586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:02:29.009586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:02:29.009586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:02:29.009586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:02:29.009586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:02:29.009586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:02:29.009586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:02:29.009586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:02:29.009586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:02:29.009586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:02:29.009586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:02:29.009586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:02:29.009586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 30 01:02:29.009586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 30 01:02:29.009586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5a56ccb6-4f95-4c54-8d07-0fab55a136b8 is already attached to instances: fcef108b-3362-4ede-8646-9b25d0cd5d33 Oct 30 01:02:29.009586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:02:29.009586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:02:29.009586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:02:29.009586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:29.009586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:02:29.011151 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:02:29.011151 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:02:29.011151 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:02:29.011151 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5a56ccb6-4f95-4c54-8d07-0fab55a136b8 is already attached to instances: fcef108b-3362-4ede-8646-9b25d0cd5d33 Oct 30 01:02:29.011151 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:02:29.011151 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-373303aa-ad40-46ba-b9c3-cfd106727819 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Returning 400 to user: Invalid volume: volume 5a56ccb6-4f95-4c54-8d07-0fab55a136b8 is already attached to instances: fcef108b-3362-4ede-8646-9b25d0cd5d33 {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:02:29.011151 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-373303aa-ad40-46ba-b9c3-cfd106727819 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "POST /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105258 Oct 30 01:02:29.011151 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 494/971] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Oct 30 01:02:28 2022] POST /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:02:29.015573 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-310bd049-63c5-4a2e-b92f-878cf313340f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:29.016102 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-310bd049-63c5-4a2e-b92f-878cf313340f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: ce0e4e1c-608e-4056-9d3b-1451ac41e206] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:29.022387 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-310bd049-63c5-4a2e-b92f-878cf313340f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:29.022868 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-310bd049-63c5-4a2e-b92f-878cf313340f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:29.023303 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-310bd049-63c5-4a2e-b92f-878cf313340f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:29.023996 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-310bd049-63c5-4a2e-b92f-878cf313340f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:29.024500 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-310bd049-63c5-4a2e-b92f-878cf313340f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:29.024926 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-310bd049-63c5-4a2e-b92f-878cf313340f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:29.050691 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-310bd049-63c5-4a2e-b92f-878cf313340f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: ce0e4e1c-608e-4056-9d3b-1451ac41e206] Going to try to terminate instance {{(pid=125553) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:02:29.126543 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-310bd049-63c5-4a2e-b92f-878cf313340f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206" status: 204 len: 0 microversion: 2.1 time: 0.114346 Oct 30 01:02:29.127155 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 478/972] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 01:02:29 2022] DELETE /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:02:29.135145 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-8798497e-833b-4cad-8e7e-cfde59e2f8f8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:29.135750 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-8798497e-833b-4cad-8e7e-cfde59e2f8f8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: ce0e4e1c-608e-4056-9d3b-1451ac41e206] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:29.143049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8798497e-833b-4cad-8e7e-cfde59e2f8f8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:29.143530 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8798497e-833b-4cad-8e7e-cfde59e2f8f8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:29.143967 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8798497e-833b-4cad-8e7e-cfde59e2f8f8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:29.144687 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8798497e-833b-4cad-8e7e-cfde59e2f8f8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:29.145139 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8798497e-833b-4cad-8e7e-cfde59e2f8f8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:29.145562 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8798497e-833b-4cad-8e7e-cfde59e2f8f8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:29.277113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-8798497e-833b-4cad-8e7e-cfde59e2f8f8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:02:29.285480 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-8798497e-833b-4cad-8e7e-cfde59e2f8f8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206" status: 200 len: 1681 microversion: 2.1 time: 0.154185 Oct 30 01:02:29.286048 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 495/973] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:02:29 2022] GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:02:30.310713 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a1e8ae77-1950-41c8-b636-419d57409394 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:30.311404 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a1e8ae77-1950-41c8-b636-419d57409394 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: ce0e4e1c-608e-4056-9d3b-1451ac41e206] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:30.318113 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a1e8ae77-1950-41c8-b636-419d57409394 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:30.318592 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a1e8ae77-1950-41c8-b636-419d57409394 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:30.319022 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a1e8ae77-1950-41c8-b636-419d57409394 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:30.319712 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a1e8ae77-1950-41c8-b636-419d57409394 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:30.320189 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a1e8ae77-1950-41c8-b636-419d57409394 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:30.320612 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a1e8ae77-1950-41c8-b636-419d57409394 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:30.451717 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a1e8ae77-1950-41c8-b636-419d57409394 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:02:30.460179 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a1e8ae77-1950-41c8-b636-419d57409394 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206" status: 200 len: 1681 microversion: 2.1 time: 0.153631 Oct 30 01:02:30.460748 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 479/974] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:02:30 2022] GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:02:31.485045 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-a1ee1c9c-fe53-4acc-aece-e40a3cedc7ef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:31.485652 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-a1ee1c9c-fe53-4acc-aece-e40a3cedc7ef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: ce0e4e1c-608e-4056-9d3b-1451ac41e206] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:31.492006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a1ee1c9c-fe53-4acc-aece-e40a3cedc7ef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:31.492607 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a1ee1c9c-fe53-4acc-aece-e40a3cedc7ef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:31.493048 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a1ee1c9c-fe53-4acc-aece-e40a3cedc7ef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:31.493741 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a1ee1c9c-fe53-4acc-aece-e40a3cedc7ef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:31.494190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a1ee1c9c-fe53-4acc-aece-e40a3cedc7ef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:31.494610 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a1ee1c9c-fe53-4acc-aece-e40a3cedc7ef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:31.741642 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-a1ee1c9c-fe53-4acc-aece-e40a3cedc7ef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:02:31.750180 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-a1ee1c9c-fe53-4acc-aece-e40a3cedc7ef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206" status: 200 len: 1681 microversion: 2.1 time: 0.269540 Oct 30 01:02:31.750858 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 496/975] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:02:31 2022] GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206 => generated 1681 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:02:31.969563 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-c64a2367-8d41-45ae-b175-d17b073fdca1 req-300a4738-e23e-4693-85ab-f500bc77860f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0e4e1c-608e-4056-9d3b-1451ac41e206", "name": "network-vif-deleted", "tag": "0b5865e3-6819-4971-a858-edb75563ec2e"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:02:31.982244 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-c64a2367-8d41-45ae-b175-d17b073fdca1 req-300a4738-e23e-4693-85ab-f500bc77860f service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:31.982736 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-c64a2367-8d41-45ae-b175-d17b073fdca1 req-300a4738-e23e-4693-85ab-f500bc77860f service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:31.983150 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-c64a2367-8d41-45ae-b175-d17b073fdca1 req-300a4738-e23e-4693-85ab-f500bc77860f service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:32.001048 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-c64a2367-8d41-45ae-b175-d17b073fdca1 req-300a4738-e23e-4693-85ab-f500bc77860f service nova] Creating event network-vif-deleted:0b5865e3-6819-4971-a858-edb75563ec2e for instance ce0e4e1c-608e-4056-9d3b-1451ac41e206 on hv-cinder-86149 Oct 30 01:02:32.007921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-c64a2367-8d41-45ae-b175-d17b073fdca1 req-300a4738-e23e-4693-85ab-f500bc77860f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044542 Oct 30 01:02:32.009385 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 480/976] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:02:32.774092 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-fe3093fd-2148-48b0-9e91-3c5072110525 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:32.774700 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-fe3093fd-2148-48b0-9e91-3c5072110525 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: ce0e4e1c-608e-4056-9d3b-1451ac41e206] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:32.782543 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fe3093fd-2148-48b0-9e91-3c5072110525 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:32.783294 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fe3093fd-2148-48b0-9e91-3c5072110525 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:32.783724 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fe3093fd-2148-48b0-9e91-3c5072110525 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:32.784459 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fe3093fd-2148-48b0-9e91-3c5072110525 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:32.784904 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fe3093fd-2148-48b0-9e91-3c5072110525 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:32.785327 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fe3093fd-2148-48b0-9e91-3c5072110525 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:32.802257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-fe3093fd-2148-48b0-9e91-3c5072110525 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] HTTP exception thrown: Instance ce0e4e1c-608e-4056-9d3b-1451ac41e206 could not be found. Oct 30 01:02:32.803885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-fe3093fd-2148-48b0-9e91-3c5072110525 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Request method failure captured: Oct 30 01:02:32.803885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206 HTTP/1.1 Oct 30 01:02:32.803885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 01:02:32.803885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 01:02:32.803885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 01:02:32.803885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 01:02:32.803885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 01:02:32.803885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 01:02:32.803885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 01:02:32.803885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 01:02:32.803885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcxY8meP6vvhjbMl5SDegLis0GNSJ-as78-NEFrPY5visYG6nAB9FJqsqSnKlmkLjDyOiz2t_9jR7dQbTJVad7Ot58e6fXvOwVA87-vsO9JQuc5io49RaVNBH3eRFW0SDeH6mC7M6KHqZYWVfoplDjyGh6d_VPsrjSppQ78VV6m9NHw Oct 30 01:02:32.803885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 01:02:32.803885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 01:02:32.803885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 01:02:32.803885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 01:02:32.803885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 01:02:32.803885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 01:02:32.803885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:02:32.803885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:02:32.803885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 01:02:32.803885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 01:02:32.805578 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:02:32.805578 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:02:32.805578 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:02:32.805578 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:02:32.805578 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:02:32.805578 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 01:02:32.805578 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 01:02:32.805578 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 7353722ccb7548a6b92c89d4917fefaa Oct 30 01:02:32.805578 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:02:32.805578 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 01:02:32.805578 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Instance ce0e4e1c-608e-4056-9d3b-1451ac41e206 could not be found. Oct 30 01:02:32.805578 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': 'ce0e4e1c-608e-4056-9d3b-1451ac41e206'} Oct 30 01:02:32.806491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:02:32.806491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:32.806491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:02:32.806491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:02:32.806491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:02:32.806491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:02:32.806491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:02:32.806491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:02:32.806491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:02:32.806491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:02:32.806491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce0e4e1c-608e-4056-9d3b-1451ac41e206 could not be found. Oct 30 01:02:32.806491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:02:32.806491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:02:32.806491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:02:32.806491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:32.806491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:02:32.806491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:02:32.806491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:02:32.806491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:02:32.806491 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:02:32.807955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:02:32.807955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:02:32.807955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:02:32.807955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:02:32.807955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:02:32.807955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:02:32.807955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:02:32.807955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce0e4e1c-608e-4056-9d3b-1451ac41e206 could not be found. Oct 30 01:02:32.807955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:02:32.807955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:02:32.807955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:02:32.807955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:32.807955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:02:32.807955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:02:32.807955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:02:32.807955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:02:32.807955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce0e4e1c-608e-4056-9d3b-1451ac41e206 could not be found. Oct 30 01:02:32.807955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:02:32.809375 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-fe3093fd-2148-48b0-9e91-3c5072110525 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Returning 404 to user: Instance ce0e4e1c-608e-4056-9d3b-1451ac41e206 could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:02:32.814992 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-fe3093fd-2148-48b0-9e91-3c5072110525 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206" status: 404 len: 111 microversion: 2.1 time: 0.044796 Oct 30 01:02:32.815571 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 497/977] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:02:32 2022] GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:02:32.824630 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-628b3aae-ead9-4a97-aba5-20130f66c66d tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '.version_select at 0x7faf75b349d0>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:32.849140 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-628b3aae-ead9-4a97-aba5-20130f66c66d tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-301521525" status: 202 len: 0 microversion: 2.1 time: 0.028725 Oct 30 01:02:32.850405 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 481/978] 10.222.0.36 () {58 vars in 1218 bytes} [Sun Oct 30 01:02:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-301521525 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:02:33.534862 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c528642e-59c4-4014-9364-e7eabad82327 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:33.535348 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c528642e-59c4-4014-9364-e7eabad82327 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:33.541302 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c528642e-59c4-4014-9364-e7eabad82327 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:33.541780 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c528642e-59c4-4014-9364-e7eabad82327 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:33.542213 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c528642e-59c4-4014-9364-e7eabad82327 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:33.542903 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c528642e-59c4-4014-9364-e7eabad82327 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:33.543350 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c528642e-59c4-4014-9364-e7eabad82327 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:33.543770 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c528642e-59c4-4014-9364-e7eabad82327 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:33.624367 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.objects.instance [None req-c528642e-59c4-4014-9364-e7eabad82327 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lazy-loading 'services' on Instance uuid fcef108b-3362-4ede-8646-9b25d0cd5d33 {{(pid=125554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:02:33.694965 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c528642e-59c4-4014-9364-e7eabad82327 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33/os-volume_attachments/5a56ccb6-4f95-4c54-8d07-0fab55a136b8" status: 202 len: 0 microversion: 2.1 time: 0.163816 Oct 30 01:02:33.695551 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 498/979] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Oct 30 01:02:33 2022] DELETE /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33/os-volume_attachments/5a56ccb6-4f95-4c54-8d07-0fab55a136b8 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:02:33.705011 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-4d0350e4-4c12-4e25-99b4-1a4ef822731c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:33.707318 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-4d0350e4-4c12-4e25-99b4-1a4ef822731c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:33.713983 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4d0350e4-4c12-4e25-99b4-1a4ef822731c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:33.714498 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4d0350e4-4c12-4e25-99b4-1a4ef822731c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:33.714929 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4d0350e4-4c12-4e25-99b4-1a4ef822731c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:33.715637 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4d0350e4-4c12-4e25-99b4-1a4ef822731c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:33.716109 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4d0350e4-4c12-4e25-99b4-1a4ef822731c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:33.716541 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4d0350e4-4c12-4e25-99b4-1a4ef822731c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:33.747149 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-4d0350e4-4c12-4e25-99b4-1a4ef822731c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046935 Oct 30 01:02:33.747703 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 482/980] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Oct 30 01:02:33 2022] GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:02:34.761439 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-54462c17-f416-4583-9e5b-cba41894f853 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:34.763781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-54462c17-f416-4583-9e5b-cba41894f853 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:34.770212 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-54462c17-f416-4583-9e5b-cba41894f853 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:34.770685 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-54462c17-f416-4583-9e5b-cba41894f853 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:34.771114 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-54462c17-f416-4583-9e5b-cba41894f853 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:34.771813 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-54462c17-f416-4583-9e5b-cba41894f853 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:34.772292 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-54462c17-f416-4583-9e5b-cba41894f853 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:34.772713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-54462c17-f416-4583-9e5b-cba41894f853 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:34.802466 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-54462c17-f416-4583-9e5b-cba41894f853 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045820 Oct 30 01:02:34.803005 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 499/981] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Oct 30 01:02:34 2022] GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:02:34.866306 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d22cdceb-a471-4daa-aa85-890919b60416 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:34.866844 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d22cdceb-a471-4daa-aa85-890919b60416 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:34.874064 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d22cdceb-a471-4daa-aa85-890919b60416 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:34.874643 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d22cdceb-a471-4daa-aa85-890919b60416 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:34.875483 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d22cdceb-a471-4daa-aa85-890919b60416 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:34.875811 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d22cdceb-a471-4daa-aa85-890919b60416 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:34.876309 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d22cdceb-a471-4daa-aa85-890919b60416 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:34.876740 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d22cdceb-a471-4daa-aa85-890919b60416 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:34.904773 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d22cdceb-a471-4daa-aa85-890919b60416 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Going to try to terminate instance {{(pid=125553) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:02:34.978189 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d22cdceb-a471-4daa-aa85-890919b60416 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33" status: 204 len: 0 microversion: 2.1 time: 0.115440 Oct 30 01:02:34.978789 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 483/982] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 01:02:34 2022] DELETE /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:02:34.987798 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-33ab22eb-224e-45c5-ac10-0e22254facfd tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:34.988430 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-33ab22eb-224e-45c5-ac10-0e22254facfd tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:34.994279 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-33ab22eb-224e-45c5-ac10-0e22254facfd tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:34.994755 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-33ab22eb-224e-45c5-ac10-0e22254facfd tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:34.995273 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-33ab22eb-224e-45c5-ac10-0e22254facfd tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:34.995982 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-33ab22eb-224e-45c5-ac10-0e22254facfd tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:34.996464 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-33ab22eb-224e-45c5-ac10-0e22254facfd tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:34.996885 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-33ab22eb-224e-45c5-ac10-0e22254facfd tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:35.125154 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-33ab22eb-224e-45c5-ac10-0e22254facfd tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:02:35.133479 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-33ab22eb-224e-45c5-ac10-0e22254facfd tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33" status: 200 len: 1681 microversion: 2.1 time: 0.149943 Oct 30 01:02:35.134030 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 500/983] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:02:34 2022] GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:02:36.157902 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f1c05aa3-1698-4e7f-8f3f-5c2fbe93cdcb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:36.158599 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f1c05aa3-1698-4e7f-8f3f-5c2fbe93cdcb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:36.164655 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f1c05aa3-1698-4e7f-8f3f-5c2fbe93cdcb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:36.165136 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f1c05aa3-1698-4e7f-8f3f-5c2fbe93cdcb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:36.165568 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f1c05aa3-1698-4e7f-8f3f-5c2fbe93cdcb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:36.166252 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f1c05aa3-1698-4e7f-8f3f-5c2fbe93cdcb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:36.166703 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f1c05aa3-1698-4e7f-8f3f-5c2fbe93cdcb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:36.167125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f1c05aa3-1698-4e7f-8f3f-5c2fbe93cdcb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:36.298696 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f1c05aa3-1698-4e7f-8f3f-5c2fbe93cdcb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:02:36.306443 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f1c05aa3-1698-4e7f-8f3f-5c2fbe93cdcb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33" status: 200 len: 1681 microversion: 2.1 time: 0.153408 Oct 30 01:02:36.307000 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 484/984] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:02:36 2022] GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:02:37.330262 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-071ab676-6ce3-4bc4-a77e-215f1603bdd6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:37.330895 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-071ab676-6ce3-4bc4-a77e-215f1603bdd6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:37.337035 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-071ab676-6ce3-4bc4-a77e-215f1603bdd6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:37.337521 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-071ab676-6ce3-4bc4-a77e-215f1603bdd6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:37.337954 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-071ab676-6ce3-4bc4-a77e-215f1603bdd6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:37.338629 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-071ab676-6ce3-4bc4-a77e-215f1603bdd6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:37.339232 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-071ab676-6ce3-4bc4-a77e-215f1603bdd6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:37.339489 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-071ab676-6ce3-4bc4-a77e-215f1603bdd6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:37.417775 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-071ab676-6ce3-4bc4-a77e-215f1603bdd6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:02:37.426165 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-071ab676-6ce3-4bc4-a77e-215f1603bdd6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33" status: 200 len: 1614 microversion: 2.1 time: 0.100382 Oct 30 01:02:37.426866 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 501/985] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:02:37 2022] GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33 => generated 1614 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:02:37.643676 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-84e08c24-cf3c-4b1a-9182-0323c91aa5f0 req-62afab2b-98fa-4dfe-819d-1e774b459ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcef108b-3362-4ede-8646-9b25d0cd5d33", "name": "network-vif-deleted", "tag": "0fb4edbc-706f-4257-b3e5-11d481fd7dc2"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:02:37.656611 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-84e08c24-cf3c-4b1a-9182-0323c91aa5f0 req-62afab2b-98fa-4dfe-819d-1e774b459ba0 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:37.657178 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-84e08c24-cf3c-4b1a-9182-0323c91aa5f0 req-62afab2b-98fa-4dfe-819d-1e774b459ba0 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:37.657673 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-84e08c24-cf3c-4b1a-9182-0323c91aa5f0 req-62afab2b-98fa-4dfe-819d-1e774b459ba0 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:37.680824 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-84e08c24-cf3c-4b1a-9182-0323c91aa5f0 req-62afab2b-98fa-4dfe-819d-1e774b459ba0 service nova] Creating event network-vif-deleted:0fb4edbc-706f-4257-b3e5-11d481fd7dc2 for instance fcef108b-3362-4ede-8646-9b25d0cd5d33 on hv-cinder-86149 Oct 30 01:02:37.687127 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-84e08c24-cf3c-4b1a-9182-0323c91aa5f0 req-62afab2b-98fa-4dfe-819d-1e774b459ba0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046891 Oct 30 01:02:37.687857 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 485/986] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:02:38.449477 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c021ef22-d5e6-4387-ac6b-9de831415f0f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:38.450128 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c021ef22-d5e6-4387-ac6b-9de831415f0f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:38.456884 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c021ef22-d5e6-4387-ac6b-9de831415f0f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:38.457371 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c021ef22-d5e6-4387-ac6b-9de831415f0f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:38.457805 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c021ef22-d5e6-4387-ac6b-9de831415f0f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:38.458512 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c021ef22-d5e6-4387-ac6b-9de831415f0f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:38.458966 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c021ef22-d5e6-4387-ac6b-9de831415f0f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:38.459390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c021ef22-d5e6-4387-ac6b-9de831415f0f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:38.473908 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-c021ef22-d5e6-4387-ac6b-9de831415f0f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] HTTP exception thrown: Instance fcef108b-3362-4ede-8646-9b25d0cd5d33 could not be found. Oct 30 01:02:38.475627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c021ef22-d5e6-4387-ac6b-9de831415f0f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Request method failure captured: Oct 30 01:02:38.475627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33 HTTP/1.1 Oct 30 01:02:38.475627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 01:02:38.475627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 01:02:38.475627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 01:02:38.475627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 01:02:38.475627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 01:02:38.475627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 01:02:38.475627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 01:02:38.475627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 01:02:38.475627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcxY8meP6vvhjbMl5SDegLis0GNSJ-as78-NEFrPY5visYG6nAB9FJqsqSnKlmkLjDyOiz2t_9jR7dQbTJVad7Ot58e6fXvOwVA87-vsO9JQuc5io49RaVNBH3eRFW0SDeH6mC7M6KHqZYWVfoplDjyGh6d_VPsrjSppQ78VV6m9NHw Oct 30 01:02:38.475627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 01:02:38.475627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 01:02:38.475627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 01:02:38.475627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 01:02:38.475627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 01:02:38.475627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 01:02:38.475627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:02:38.475627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:02:38.475627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 01:02:38.475627 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 01:02:38.477603 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:02:38.477603 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:02:38.477603 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:02:38.477603 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:02:38.477603 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:02:38.477603 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 01:02:38.477603 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 01:02:38.477603 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 7353722ccb7548a6b92c89d4917fefaa Oct 30 01:02:38.477603 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:02:38.477603 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 01:02:38.477603 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Instance fcef108b-3362-4ede-8646-9b25d0cd5d33 could not be found. Oct 30 01:02:38.477603 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': 'fcef108b-3362-4ede-8646-9b25d0cd5d33'} Oct 30 01:02:38.478617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:02:38.478617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:38.478617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:02:38.478617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:02:38.478617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:02:38.478617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:02:38.478617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:02:38.478617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:02:38.478617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:02:38.478617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:02:38.478617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcef108b-3362-4ede-8646-9b25d0cd5d33 could not be found. Oct 30 01:02:38.478617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:02:38.478617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:02:38.478617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:02:38.478617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:38.478617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:02:38.478617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:02:38.478617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:02:38.478617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:02:38.478617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:02:38.480214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:02:38.480214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:02:38.480214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:02:38.480214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:02:38.480214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:02:38.480214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:02:38.480214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:02:38.480214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcef108b-3362-4ede-8646-9b25d0cd5d33 could not be found. Oct 30 01:02:38.480214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:02:38.480214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:02:38.480214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:02:38.480214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:02:38.480214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:02:38.480214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:02:38.480214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:02:38.480214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:02:38.480214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcef108b-3362-4ede-8646-9b25d0cd5d33 could not be found. Oct 30 01:02:38.480214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:02:38.481713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c021ef22-d5e6-4387-ac6b-9de831415f0f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Returning 404 to user: Instance fcef108b-3362-4ede-8646-9b25d0cd5d33 could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:02:38.481713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c021ef22-d5e6-4387-ac6b-9de831415f0f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33" status: 404 len: 111 microversion: 2.1 time: 0.031775 Oct 30 01:02:38.481713 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 502/987] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:02:38 2022] GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:02:38.488543 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-fd2b9f4b-e9e4-4935-a558-9d079f813adf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '.version_select at 0x7faf75bb5820>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:38.507838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-fd2b9f4b-e9e4-4935-a558-9d079f813adf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523845397" status: 202 len: 0 microversion: 2.1 time: 0.023465 Oct 30 01:02:38.508667 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 486/988] 10.222.0.36 () {58 vars in 1221 bytes} [Sun Oct 30 01:02:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523845397 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:02:39.132389 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-03a30007-e655-41fd-8e80-9448340144c8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Action: 'create', calling method: .version_select at 0x7faf79253430>, body: {"keypair": {"name": "tempest-keypair-1759263414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7yoaNSaH6m4NKnv9n1bEMc9zIwnV7/IRuEcMARdiHQsPWtT2xY5aLClNjX1JaxPKV/loTbn2HqY2k3+8zA6DJmijx+AeEpHon6U6BTHqJG4SrxF3Z+2fOh1YyRtxECHA=="}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:02:39.147584 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-03a30007-e655-41fd-8e80-9448340144c8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Getting quotas for project dc70ef555fc84a51b3521007d00b77e3. Resources: {'key_pairs'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:02:39.151462 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-03a30007-e655-41fd-8e80-9448340144c8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Getting quotas for user 7353722ccb7548a6b92c89d4917fefaa and project dc70ef555fc84a51b3521007d00b77e3. Resources: {'key_pairs'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:02:39.173877 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-03a30007-e655-41fd-8e80-9448340144c8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045262 Oct 30 01:02:39.174600 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 503/989] 10.222.0.36 () {60 vars in 1159 bytes} [Sun Oct 30 01:02:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:02:40.357296 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-9a50b180-2328-4134-8255-bae608c4dc89 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-879747192", "imageRef": "27983dee-4bd6-4aad-9c28-22bd5382709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c4c02ee-d590-4828-8332-2711b92b38f9"}], "security_groups": [{"name": "tempest-securitygroup--1125748029"}], "key_name": "tempest-keypair-1759263414", "user_data": "}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:02:40.459801 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.network.neutron [None req-9a50b180-2328-4134-8255-bae608c4dc89 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] validate_networks() for [('8c4c02ee-d590-4828-8332-2711b92b38f9', None, None, None, None, None)] {{(pid=125553) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:02:40.829800 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-9a50b180-2328-4134-8255-bae608c4dc89 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Flavor limits 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:02:40.830219 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-9a50b180-2328-4134-8255-bae608c4dc89 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Image limits 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:02:40.830686 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-9a50b180-2328-4134-8255-bae608c4dc89 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Flavor pref 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:02:40.831254 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-9a50b180-2328-4134-8255-bae608c4dc89 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Image pref 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:02:40.831666 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-9a50b180-2328-4134-8255-bae608c4dc89 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:02:40.840313 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9a50b180-2328-4134-8255-bae608c4dc89 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:40.841372 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9a50b180-2328-4134-8255-bae608c4dc89 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:40.841823 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9a50b180-2328-4134-8255-bae608c4dc89 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:40.842549 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9a50b180-2328-4134-8255-bae608c4dc89 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:40.842997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9a50b180-2328-4134-8255-bae608c4dc89 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:40.843413 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9a50b180-2328-4134-8255-bae608c4dc89 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:40.860288 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-9a50b180-2328-4134-8255-bae608c4dc89 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Getting quotas for project dc70ef555fc84a51b3521007d00b77e3. Resources: {'instances', 'cores', 'ram'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:02:40.864162 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-9a50b180-2328-4134-8255-bae608c4dc89 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Getting quotas for user 7353722ccb7548a6b92c89d4917fefaa and project dc70ef555fc84a51b3521007d00b77e3. Resources: {'instances', 'cores', 'ram'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:02:40.876223 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-9a50b180-2328-4134-8255-bae608c4dc89 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Going to run 1 instances... {{(pid=125553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:02:40.878600 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-9a50b180-2328-4134-8255-bae608c4dc89 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27983dee-4bd6-4aad-9c28-22bd5382709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:02:40.929445 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-9a50b180-2328-4134-8255-bae608c4dc89 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.576568 Oct 30 01:02:40.930077 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 487/990] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Oct 30 01:02:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:02:40.942133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-6055edfa-1bd3-49ea-b1b2-5679d75b208e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:40.942921 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-6055edfa-1bd3-49ea-b1b2-5679d75b208e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:41.001512 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6055edfa-1bd3-49ea-b1b2-5679d75b208e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:02:41.008795 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-6055edfa-1bd3-49ea-b1b2-5679d75b208e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36" status: 200 len: 1241 microversion: 2.1 time: 0.070961 Oct 30 01:02:41.009420 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 504/991] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:02:40 2022] GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:02:42.033742 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-95e841ef-e540-4389-9e0f-496c3ff03f12 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:42.034456 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-95e841ef-e540-4389-9e0f-496c3ff03f12 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:42.041521 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-95e841ef-e540-4389-9e0f-496c3ff03f12 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:42.042211 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-95e841ef-e540-4389-9e0f-496c3ff03f12 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:42.042650 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-95e841ef-e540-4389-9e0f-496c3ff03f12 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:42.043349 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-95e841ef-e540-4389-9e0f-496c3ff03f12 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:42.043970 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-95e841ef-e540-4389-9e0f-496c3ff03f12 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:42.044913 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-95e841ef-e540-4389-9e0f-496c3ff03f12 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:42.118740 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-95e841ef-e540-4389-9e0f-496c3ff03f12 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:02:42.127286 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-95e841ef-e540-4389-9e0f-496c3ff03f12 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36" status: 200 len: 1311 microversion: 2.1 time: 0.098777 Oct 30 01:02:42.127918 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 488/992] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:02:42 2022] GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:02:43.150938 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-60d03a8b-b0ef-4a4c-9fa6-4d570760601d tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:43.151548 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-60d03a8b-b0ef-4a4c-9fa6-4d570760601d tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:43.158501 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-60d03a8b-b0ef-4a4c-9fa6-4d570760601d tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:43.158986 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-60d03a8b-b0ef-4a4c-9fa6-4d570760601d tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:43.159421 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-60d03a8b-b0ef-4a4c-9fa6-4d570760601d tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:43.160133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-60d03a8b-b0ef-4a4c-9fa6-4d570760601d tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:43.160588 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-60d03a8b-b0ef-4a4c-9fa6-4d570760601d tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:43.161008 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-60d03a8b-b0ef-4a4c-9fa6-4d570760601d tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:43.372818 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-60d03a8b-b0ef-4a4c-9fa6-4d570760601d tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:02:43.380594 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-60d03a8b-b0ef-4a4c-9fa6-4d570760601d tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36" status: 200 len: 1367 microversion: 2.1 time: 0.233634 Oct 30 01:02:43.381153 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 505/993] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:02:43 2022] GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:02:43.696415 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-b4e5a16f-5178-4d43-8e85-06c7b6895ca5 req-6627ba10-2065-4569-9def-ee931c3bc988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5dcd920-bcaa-4627-9732-fbc5032e7c36", "tag": "0afb6a7a-03c6-479e-90fb-5bcc257d9d36"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:02:43.709196 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-b4e5a16f-5178-4d43-8e85-06c7b6895ca5 req-6627ba10-2065-4569-9def-ee931c3bc988 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:43.709671 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-b4e5a16f-5178-4d43-8e85-06c7b6895ca5 req-6627ba10-2065-4569-9def-ee931c3bc988 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:43.710089 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-b4e5a16f-5178-4d43-8e85-06c7b6895ca5 req-6627ba10-2065-4569-9def-ee931c3bc988 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:43.722295 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-b4e5a16f-5178-4d43-8e85-06c7b6895ca5 req-6627ba10-2065-4569-9def-ee931c3bc988 service nova] Creating event network-changed:0afb6a7a-03c6-479e-90fb-5bcc257d9d36 for instance c5dcd920-bcaa-4627-9732-fbc5032e7c36 on hv-cinder-86149 Oct 30 01:02:43.727368 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-b4e5a16f-5178-4d43-8e85-06c7b6895ca5 req-6627ba10-2065-4569-9def-ee931c3bc988 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034669 Oct 30 01:02:43.728353 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 489/994] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:02:44.404035 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-fd0f1bc6-f5bf-4c15-8db2-a48f90180b7d tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:44.404754 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-fd0f1bc6-f5bf-4c15-8db2-a48f90180b7d tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:44.411195 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fd0f1bc6-f5bf-4c15-8db2-a48f90180b7d tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:44.411675 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fd0f1bc6-f5bf-4c15-8db2-a48f90180b7d tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:44.412129 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fd0f1bc6-f5bf-4c15-8db2-a48f90180b7d tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:44.412825 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fd0f1bc6-f5bf-4c15-8db2-a48f90180b7d tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:44.413273 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fd0f1bc6-f5bf-4c15-8db2-a48f90180b7d tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:44.413692 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fd0f1bc6-f5bf-4c15-8db2-a48f90180b7d tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:44.548552 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-fd0f1bc6-f5bf-4c15-8db2-a48f90180b7d tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:02:44.556140 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-fd0f1bc6-f5bf-4c15-8db2-a48f90180b7d tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36" status: 200 len: 1367 microversion: 2.1 time: 0.155967 Oct 30 01:02:44.556701 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 506/995] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:02:44 2022] GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:02:45.580170 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-37098d39-ec39-4cd8-b778-2997680c18f5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:45.580802 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-37098d39-ec39-4cd8-b778-2997680c18f5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:45.587019 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-37098d39-ec39-4cd8-b778-2997680c18f5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:45.587502 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-37098d39-ec39-4cd8-b778-2997680c18f5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:45.587939 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-37098d39-ec39-4cd8-b778-2997680c18f5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:45.588664 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-37098d39-ec39-4cd8-b778-2997680c18f5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:45.589222 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-37098d39-ec39-4cd8-b778-2997680c18f5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:45.590328 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-37098d39-ec39-4cd8-b778-2997680c18f5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:45.717760 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-37098d39-ec39-4cd8-b778-2997680c18f5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:02:45.725544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-37098d39-ec39-4cd8-b778-2997680c18f5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36" status: 200 len: 1367 microversion: 2.1 time: 0.150234 Oct 30 01:02:45.726095 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 490/996] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:02:45 2022] GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:02:46.747784 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-cd6d2e85-72e5-498a-82ab-225b4d32806c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:46.748361 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-cd6d2e85-72e5-498a-82ab-225b4d32806c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:46.754916 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cd6d2e85-72e5-498a-82ab-225b4d32806c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:46.755396 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cd6d2e85-72e5-498a-82ab-225b4d32806c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:46.755834 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cd6d2e85-72e5-498a-82ab-225b4d32806c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:46.756564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cd6d2e85-72e5-498a-82ab-225b4d32806c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:46.757017 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cd6d2e85-72e5-498a-82ab-225b4d32806c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:46.757445 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cd6d2e85-72e5-498a-82ab-225b4d32806c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:46.886883 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-cd6d2e85-72e5-498a-82ab-225b4d32806c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:02:46.896804 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-cd6d2e85-72e5-498a-82ab-225b4d32806c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36" status: 200 len: 1367 microversion: 2.1 time: 0.152735 Oct 30 01:02:46.897404 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 507/997] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:02:46 2022] GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:02:47.922188 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-28ca3925-7ea9-40d4-9771-c63606c2a977 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:47.922804 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-28ca3925-7ea9-40d4-9771-c63606c2a977 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:47.929257 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-28ca3925-7ea9-40d4-9771-c63606c2a977 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:47.929746 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-28ca3925-7ea9-40d4-9771-c63606c2a977 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:47.930182 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-28ca3925-7ea9-40d4-9771-c63606c2a977 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:47.930880 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-28ca3925-7ea9-40d4-9771-c63606c2a977 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:47.931335 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-28ca3925-7ea9-40d4-9771-c63606c2a977 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:47.931764 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-28ca3925-7ea9-40d4-9771-c63606c2a977 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:48.066869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-28ca3925-7ea9-40d4-9771-c63606c2a977 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:02:48.074533 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-28ca3925-7ea9-40d4-9771-c63606c2a977 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36" status: 200 len: 1367 microversion: 2.1 time: 0.156306 Oct 30 01:02:48.075098 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 491/998] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:02:47 2022] GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:02:49.096421 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-a60b1838-54b6-42b7-be29-5d6a394d45fc tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:49.097021 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-a60b1838-54b6-42b7-be29-5d6a394d45fc tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:49.103643 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a60b1838-54b6-42b7-be29-5d6a394d45fc tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:49.104155 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a60b1838-54b6-42b7-be29-5d6a394d45fc tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:49.105525 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a60b1838-54b6-42b7-be29-5d6a394d45fc tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:49.106649 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a60b1838-54b6-42b7-be29-5d6a394d45fc tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:49.106649 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a60b1838-54b6-42b7-be29-5d6a394d45fc tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:49.107184 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a60b1838-54b6-42b7-be29-5d6a394d45fc tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:49.231620 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-a60b1838-54b6-42b7-be29-5d6a394d45fc tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:02:49.239224 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-a60b1838-54b6-42b7-be29-5d6a394d45fc tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36" status: 200 len: 1367 microversion: 2.1 time: 0.146628 Oct 30 01:02:49.239781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 508/999] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:02:49 2022] GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:02:49.797763 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-85018e97-a8ac-4392-9dc1-014e42810913 req-48111178-ad84-4790-ac98-e36f89d63b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5dcd920-bcaa-4627-9732-fbc5032e7c36", "name": "network-vif-plugged", "status": "completed", "tag": "0afb6a7a-03c6-479e-90fb-5bcc257d9d36"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:02:49.807844 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-85018e97-a8ac-4392-9dc1-014e42810913 req-48111178-ad84-4790-ac98-e36f89d63b86 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:49.808383 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-85018e97-a8ac-4392-9dc1-014e42810913 req-48111178-ad84-4790-ac98-e36f89d63b86 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:49.808814 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-85018e97-a8ac-4392-9dc1-014e42810913 req-48111178-ad84-4790-ac98-e36f89d63b86 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:49.820555 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-85018e97-a8ac-4392-9dc1-014e42810913 req-48111178-ad84-4790-ac98-e36f89d63b86 service nova] Creating event network-vif-plugged:0afb6a7a-03c6-479e-90fb-5bcc257d9d36 for instance c5dcd920-bcaa-4627-9732-fbc5032e7c36 on hv-cinder-86149 Oct 30 01:02:49.825592 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-85018e97-a8ac-4392-9dc1-014e42810913 req-48111178-ad84-4790-ac98-e36f89d63b86 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031554 Oct 30 01:02:49.826185 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 492/1000] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:02:50.262031 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-cbcb909d-c5e4-419e-abe7-84e9c2566451 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:50.262578 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-cbcb909d-c5e4-419e-abe7-84e9c2566451 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:50.268964 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cbcb909d-c5e4-419e-abe7-84e9c2566451 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:50.269448 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cbcb909d-c5e4-419e-abe7-84e9c2566451 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:50.269880 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cbcb909d-c5e4-419e-abe7-84e9c2566451 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:50.270565 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cbcb909d-c5e4-419e-abe7-84e9c2566451 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:50.271014 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cbcb909d-c5e4-419e-abe7-84e9c2566451 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:50.271431 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cbcb909d-c5e4-419e-abe7-84e9c2566451 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:50.397941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-cbcb909d-c5e4-419e-abe7-84e9c2566451 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:02:50.405601 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-cbcb909d-c5e4-419e-abe7-84e9c2566451 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36" status: 200 len: 1367 microversion: 2.1 time: 0.147627 Oct 30 01:02:50.406154 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 509/1001] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:02:50 2022] GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:02:51.427482 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=2 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:02:51.428272 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=6 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:02:51.433488 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a8f675ca-6d1e-4fec-9229-01c675960c10 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:51.434154 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a8f675ca-6d1e-4fec-9229-01c675960c10 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:51.441093 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a8f675ca-6d1e-4fec-9229-01c675960c10 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:51.441573 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a8f675ca-6d1e-4fec-9229-01c675960c10 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:51.442002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a8f675ca-6d1e-4fec-9229-01c675960c10 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:51.442687 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a8f675ca-6d1e-4fec-9229-01c675960c10 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:51.443138 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a8f675ca-6d1e-4fec-9229-01c675960c10 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:51.443558 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a8f675ca-6d1e-4fec-9229-01c675960c10 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:51.574828 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a8f675ca-6d1e-4fec-9229-01c675960c10 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:02:51.582491 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a8f675ca-6d1e-4fec-9229-01c675960c10 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36" status: 200 len: 1367 microversion: 2.1 time: 0.156397 Oct 30 01:02:51.583068 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 493/1002] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:02:51 2022] GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:02:52.605523 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4e361a26-7d29-4bb6-8db8-c2541d971c4f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:52.606091 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-4e361a26-7d29-4bb6-8db8-c2541d971c4f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:52.607998 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=6 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:02:52.613674 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e361a26-7d29-4bb6-8db8-c2541d971c4f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:52.614146 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e361a26-7d29-4bb6-8db8-c2541d971c4f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:52.614588 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e361a26-7d29-4bb6-8db8-c2541d971c4f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:52.615246 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e361a26-7d29-4bb6-8db8-c2541d971c4f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:52.615690 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e361a26-7d29-4bb6-8db8-c2541d971c4f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:52.616136 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e361a26-7d29-4bb6-8db8-c2541d971c4f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:52.742966 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4e361a26-7d29-4bb6-8db8-c2541d971c4f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:02:52.751252 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-4e361a26-7d29-4bb6-8db8-c2541d971c4f tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36" status: 200 len: 1557 microversion: 2.1 time: 0.149837 Oct 30 01:02:52.751802 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 510/1003] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:02:52 2022] GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:02:52.774658 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5a457dea-35b5-455f-9090-17c5e083fc8a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:02:52.775274 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5a457dea-35b5-455f-9090-17c5e083fc8a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:02:52.781578 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a457dea-35b5-455f-9090-17c5e083fc8a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:52.782056 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a457dea-35b5-455f-9090-17c5e083fc8a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:52.782490 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a457dea-35b5-455f-9090-17c5e083fc8a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:52.783180 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a457dea-35b5-455f-9090-17c5e083fc8a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:52.783630 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a457dea-35b5-455f-9090-17c5e083fc8a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:52.784054 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5a457dea-35b5-455f-9090-17c5e083fc8a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:52.860024 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5a457dea-35b5-455f-9090-17c5e083fc8a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089166 Oct 30 01:02:52.860666 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 494/1004] 10.222.0.36 () {58 vars in 1275 bytes} [Sun Oct 30 01:02:52 2022] GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:02:53.772700 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-c445ec46-9fd5-45d7-b2fa-c9d319cc7426 req-9934cf02-1760-4807-bd71-97034f3f3bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5dcd920-bcaa-4627-9732-fbc5032e7c36", "tag": "0afb6a7a-03c6-479e-90fb-5bcc257d9d36"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:02:53.783494 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-c445ec46-9fd5-45d7-b2fa-c9d319cc7426 req-9934cf02-1760-4807-bd71-97034f3f3bd3 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:02:53.783964 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-c445ec46-9fd5-45d7-b2fa-c9d319cc7426 req-9934cf02-1760-4807-bd71-97034f3f3bd3 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:02:53.784417 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-c445ec46-9fd5-45d7-b2fa-c9d319cc7426 req-9934cf02-1760-4807-bd71-97034f3f3bd3 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:02:53.796431 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-c445ec46-9fd5-45d7-b2fa-c9d319cc7426 req-9934cf02-1760-4807-bd71-97034f3f3bd3 service nova] Creating event network-changed:0afb6a7a-03c6-479e-90fb-5bcc257d9d36 for instance c5dcd920-bcaa-4627-9732-fbc5032e7c36 on hv-cinder-86149 Oct 30 01:02:53.801439 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-c445ec46-9fd5-45d7-b2fa-c9d319cc7426 req-9934cf02-1760-4807-bd71-97034f3f3bd3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032371 Oct 30 01:02:53.802031 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 511/1005] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:03:13.342773 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:13.343517 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:13.348135 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-78e01914-6572-4181-8d0d-b0cd426097c2 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:03:13.348698 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-78e01914-6572-4181-8d0d-b0cd426097c2 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:13.356329 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-78e01914-6572-4181-8d0d-b0cd426097c2 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:13.356889 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-78e01914-6572-4181-8d0d-b0cd426097c2 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:13.357322 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-78e01914-6572-4181-8d0d-b0cd426097c2 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:13.358012 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-78e01914-6572-4181-8d0d-b0cd426097c2 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:13.358462 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-78e01914-6572-4181-8d0d-b0cd426097c2 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:13.358882 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-78e01914-6572-4181-8d0d-b0cd426097c2 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:13.383358 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.objects.instance [None req-78e01914-6572-4181-8d0d-b0cd426097c2 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lazy-loading 'flavor' on Instance uuid f441dbc7-8369-4779-a326-78cbd6e9bc9d {{(pid=125553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:03:13.454139 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-78e01914-6572-4181-8d0d-b0cd426097c2 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "POST /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d/action" status: 202 len: 0 microversion: 2.1 time: 0.112524 Oct 30 01:03:13.454709 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 495/1006] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Oct 30 01:03:13 2022] POST /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:03:13.460917 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:13.461726 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:03:13.467028 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c52fed80-716f-494f-a2fd-e72e5d35c0d6 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:13.467733 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c52fed80-716f-494f-a2fd-e72e5d35c0d6 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:13.477008 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c52fed80-716f-494f-a2fd-e72e5d35c0d6 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:13.477678 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c52fed80-716f-494f-a2fd-e72e5d35c0d6 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:13.478155 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c52fed80-716f-494f-a2fd-e72e5d35c0d6 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:13.479011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c52fed80-716f-494f-a2fd-e72e5d35c0d6 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:13.479485 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c52fed80-716f-494f-a2fd-e72e5d35c0d6 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:13.479911 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c52fed80-716f-494f-a2fd-e72e5d35c0d6 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:13.613390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c52fed80-716f-494f-a2fd-e72e5d35c0d6 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:13.621874 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c52fed80-716f-494f-a2fd-e72e5d35c0d6 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1564 microversion: 2.1 time: 0.162675 Oct 30 01:03:13.622427 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 512/1007] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:13 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:03:14.646637 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-27662cc5-2995-4c2e-8c9c-c1afdb6b5ba3 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:14.647339 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-27662cc5-2995-4c2e-8c9c-c1afdb6b5ba3 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:14.654085 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-27662cc5-2995-4c2e-8c9c-c1afdb6b5ba3 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:14.654565 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-27662cc5-2995-4c2e-8c9c-c1afdb6b5ba3 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:14.654999 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-27662cc5-2995-4c2e-8c9c-c1afdb6b5ba3 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:14.655685 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-27662cc5-2995-4c2e-8c9c-c1afdb6b5ba3 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:14.656168 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-27662cc5-2995-4c2e-8c9c-c1afdb6b5ba3 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:14.656593 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-27662cc5-2995-4c2e-8c9c-c1afdb6b5ba3 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:14.791064 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-27662cc5-2995-4c2e-8c9c-c1afdb6b5ba3 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:14.798806 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-27662cc5-2995-4c2e-8c9c-c1afdb6b5ba3 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1564 microversion: 2.1 time: 0.156862 Oct 30 01:03:14.799358 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 496/1008] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:14 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:03:15.822698 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-e59c461f-12e5-4159-aaf5-11fc67a6b47f tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:15.823581 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-e59c461f-12e5-4159-aaf5-11fc67a6b47f tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:15.830143 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e59c461f-12e5-4159-aaf5-11fc67a6b47f tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:15.830686 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e59c461f-12e5-4159-aaf5-11fc67a6b47f tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:15.831186 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e59c461f-12e5-4159-aaf5-11fc67a6b47f tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:15.832068 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e59c461f-12e5-4159-aaf5-11fc67a6b47f tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:15.832659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e59c461f-12e5-4159-aaf5-11fc67a6b47f tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:15.833145 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e59c461f-12e5-4159-aaf5-11fc67a6b47f tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:15.970392 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e59c461f-12e5-4159-aaf5-11fc67a6b47f tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:15.979488 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-e59c461f-12e5-4159-aaf5-11fc67a6b47f tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1564 microversion: 2.1 time: 0.160772 Oct 30 01:03:15.980274 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 513/1009] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:15 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:03:17.002470 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-40050ea4-0ae8-40b3-986e-ec6c3ea44ef7 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:17.003079 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-40050ea4-0ae8-40b3-986e-ec6c3ea44ef7 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:17.010750 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-40050ea4-0ae8-40b3-986e-ec6c3ea44ef7 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:17.011225 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-40050ea4-0ae8-40b3-986e-ec6c3ea44ef7 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:17.011651 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-40050ea4-0ae8-40b3-986e-ec6c3ea44ef7 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:17.012429 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-40050ea4-0ae8-40b3-986e-ec6c3ea44ef7 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:17.012887 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-40050ea4-0ae8-40b3-986e-ec6c3ea44ef7 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:17.013304 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-40050ea4-0ae8-40b3-986e-ec6c3ea44ef7 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:17.144719 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-40050ea4-0ae8-40b3-986e-ec6c3ea44ef7 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:17.153122 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-40050ea4-0ae8-40b3-986e-ec6c3ea44ef7 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1564 microversion: 2.1 time: 0.154570 Oct 30 01:03:17.153676 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 497/1010] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:16 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:03:18.176028 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-8c1cca8b-7d6b-42aa-aa23-907f95cc9c1e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:18.176765 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-8c1cca8b-7d6b-42aa-aa23-907f95cc9c1e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:18.183120 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8c1cca8b-7d6b-42aa-aa23-907f95cc9c1e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:18.183598 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8c1cca8b-7d6b-42aa-aa23-907f95cc9c1e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:18.184028 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8c1cca8b-7d6b-42aa-aa23-907f95cc9c1e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:18.184741 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8c1cca8b-7d6b-42aa-aa23-907f95cc9c1e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:18.185193 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8c1cca8b-7d6b-42aa-aa23-907f95cc9c1e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:18.185613 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8c1cca8b-7d6b-42aa-aa23-907f95cc9c1e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:18.320020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-8c1cca8b-7d6b-42aa-aa23-907f95cc9c1e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:18.327657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-8c1cca8b-7d6b-42aa-aa23-907f95cc9c1e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1564 microversion: 2.1 time: 0.155511 Oct 30 01:03:18.328236 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 514/1011] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:18 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:03:19.352903 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-07484812-fdce-4b73-8712-9e29b637f0a2 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:19.353513 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-07484812-fdce-4b73-8712-9e29b637f0a2 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:19.359898 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-07484812-fdce-4b73-8712-9e29b637f0a2 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:19.360415 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-07484812-fdce-4b73-8712-9e29b637f0a2 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:19.360848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-07484812-fdce-4b73-8712-9e29b637f0a2 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:19.361677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-07484812-fdce-4b73-8712-9e29b637f0a2 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:19.362218 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-07484812-fdce-4b73-8712-9e29b637f0a2 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:19.362726 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-07484812-fdce-4b73-8712-9e29b637f0a2 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:19.497208 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-07484812-fdce-4b73-8712-9e29b637f0a2 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:19.505086 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-07484812-fdce-4b73-8712-9e29b637f0a2 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1564 microversion: 2.1 time: 0.156646 Oct 30 01:03:19.505583 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 498/1012] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:19 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:03:20.528952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-68104f83-c1ed-40e4-b1da-6b5b11303cb4 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:20.529706 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-68104f83-c1ed-40e4-b1da-6b5b11303cb4 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:20.536178 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-68104f83-c1ed-40e4-b1da-6b5b11303cb4 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:20.536755 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-68104f83-c1ed-40e4-b1da-6b5b11303cb4 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:20.537189 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-68104f83-c1ed-40e4-b1da-6b5b11303cb4 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:20.537905 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-68104f83-c1ed-40e4-b1da-6b5b11303cb4 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:20.538358 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-68104f83-c1ed-40e4-b1da-6b5b11303cb4 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:20.538904 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-68104f83-c1ed-40e4-b1da-6b5b11303cb4 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:20.672303 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-68104f83-c1ed-40e4-b1da-6b5b11303cb4 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:20.680655 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-68104f83-c1ed-40e4-b1da-6b5b11303cb4 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1564 microversion: 2.1 time: 0.155586 Oct 30 01:03:20.681210 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 515/1013] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:20 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:03:21.703702 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-ed0fd03f-f897-491f-96e1-26f176a62f79 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:21.704334 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-ed0fd03f-f897-491f-96e1-26f176a62f79 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:21.711452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ed0fd03f-f897-491f-96e1-26f176a62f79 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:21.712139 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ed0fd03f-f897-491f-96e1-26f176a62f79 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:21.712574 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ed0fd03f-f897-491f-96e1-26f176a62f79 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:21.713261 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ed0fd03f-f897-491f-96e1-26f176a62f79 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:21.713711 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ed0fd03f-f897-491f-96e1-26f176a62f79 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:21.714129 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ed0fd03f-f897-491f-96e1-26f176a62f79 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:21.851784 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ed0fd03f-f897-491f-96e1-26f176a62f79 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:21.859691 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-ed0fd03f-f897-491f-96e1-26f176a62f79 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1564 microversion: 2.1 time: 0.159768 Oct 30 01:03:21.860295 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 499/1014] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:21 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:03:22.885114 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-6304eec2-8517-4d2e-a044-3d02d7cc7f79 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:22.885746 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-6304eec2-8517-4d2e-a044-3d02d7cc7f79 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:22.892168 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6304eec2-8517-4d2e-a044-3d02d7cc7f79 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:22.892638 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6304eec2-8517-4d2e-a044-3d02d7cc7f79 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:22.893065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6304eec2-8517-4d2e-a044-3d02d7cc7f79 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:22.893749 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6304eec2-8517-4d2e-a044-3d02d7cc7f79 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:22.894192 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6304eec2-8517-4d2e-a044-3d02d7cc7f79 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:22.894605 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6304eec2-8517-4d2e-a044-3d02d7cc7f79 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:23.023364 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6304eec2-8517-4d2e-a044-3d02d7cc7f79 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:23.031162 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-6304eec2-8517-4d2e-a044-3d02d7cc7f79 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1564 microversion: 2.1 time: 0.151070 Oct 30 01:03:23.031728 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 516/1015] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:22 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1564 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:03:24.054142 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-6ff082c6-ab00-42a1-a240-b2f5ebf4ffb8 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:24.055793 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-6ff082c6-ab00-42a1-a240-b2f5ebf4ffb8 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:24.062947 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6ff082c6-ab00-42a1-a240-b2f5ebf4ffb8 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:24.063358 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6ff082c6-ab00-42a1-a240-b2f5ebf4ffb8 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:24.063805 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6ff082c6-ab00-42a1-a240-b2f5ebf4ffb8 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:24.064525 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6ff082c6-ab00-42a1-a240-b2f5ebf4ffb8 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:24.064975 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6ff082c6-ab00-42a1-a240-b2f5ebf4ffb8 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:24.065411 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6ff082c6-ab00-42a1-a240-b2f5ebf4ffb8 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:24.304883 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-6ff082c6-ab00-42a1-a240-b2f5ebf4ffb8 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:24.312557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-6ff082c6-ab00-42a1-a240-b2f5ebf4ffb8 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1564 microversion: 2.1 time: 0.262401 Oct 30 01:03:24.313390 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 500/1016] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:24 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1564 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:03:25.335819 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d9118347-7e33-4c56-a13d-d60ea7a98b53 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:25.336473 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-d9118347-7e33-4c56-a13d-d60ea7a98b53 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:25.343198 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d9118347-7e33-4c56-a13d-d60ea7a98b53 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:25.343668 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d9118347-7e33-4c56-a13d-d60ea7a98b53 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:25.344113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d9118347-7e33-4c56-a13d-d60ea7a98b53 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:25.344796 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d9118347-7e33-4c56-a13d-d60ea7a98b53 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:25.345245 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d9118347-7e33-4c56-a13d-d60ea7a98b53 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:25.345664 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d9118347-7e33-4c56-a13d-d60ea7a98b53 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:25.476750 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-d9118347-7e33-4c56-a13d-d60ea7a98b53 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:25.484490 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-d9118347-7e33-4c56-a13d-d60ea7a98b53 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1564 microversion: 2.1 time: 0.153138 Oct 30 01:03:25.485047 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 517/1017] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:25 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:03:26.507375 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-6735ac38-9296-4045-9571-8e177fd8364d tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:26.508064 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-6735ac38-9296-4045-9571-8e177fd8364d tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:26.514491 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6735ac38-9296-4045-9571-8e177fd8364d tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:26.514966 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6735ac38-9296-4045-9571-8e177fd8364d tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:26.515394 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6735ac38-9296-4045-9571-8e177fd8364d tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:26.516115 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6735ac38-9296-4045-9571-8e177fd8364d tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:26.516570 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6735ac38-9296-4045-9571-8e177fd8364d tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:26.516992 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6735ac38-9296-4045-9571-8e177fd8364d tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:26.705751 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-6735ac38-9296-4045-9571-8e177fd8364d tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:26.719459 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-6735ac38-9296-4045-9571-8e177fd8364d tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1565 microversion: 2.1 time: 0.216052 Oct 30 01:03:26.720031 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 501/1018] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:26 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1565 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:03:26.744325 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f0129e9c-8c97-4c55-90ed-b4f26040af6f tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:03:26.744914 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-f0129e9c-8c97-4c55-90ed-b4f26040af6f tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:26.751227 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f0129e9c-8c97-4c55-90ed-b4f26040af6f tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:26.751699 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f0129e9c-8c97-4c55-90ed-b4f26040af6f tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:26.752156 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f0129e9c-8c97-4c55-90ed-b4f26040af6f tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:26.752836 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f0129e9c-8c97-4c55-90ed-b4f26040af6f tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:26.753281 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f0129e9c-8c97-4c55-90ed-b4f26040af6f tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:26.753695 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f0129e9c-8c97-4c55-90ed-b4f26040af6f tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:26.794989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-f0129e9c-8c97-4c55-90ed-b4f26040af6f tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125554) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 30 01:03:26.859319 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-f0129e9c-8c97-4c55-90ed-b4f26040af6f tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "POST /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d/action" status: 202 len: 0 microversion: 2.1 time: 0.120121 Oct 30 01:03:26.859840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 518/1019] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Oct 30 01:03:26 2022] POST /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:03:26.869602 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d137c2a5-92a8-4f45-9f28-229a8036839b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:26.870282 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d137c2a5-92a8-4f45-9f28-229a8036839b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:26.876762 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d137c2a5-92a8-4f45-9f28-229a8036839b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:26.877248 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d137c2a5-92a8-4f45-9f28-229a8036839b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:26.877777 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d137c2a5-92a8-4f45-9f28-229a8036839b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:26.878433 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d137c2a5-92a8-4f45-9f28-229a8036839b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:26.878890 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d137c2a5-92a8-4f45-9f28-229a8036839b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:26.879549 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d137c2a5-92a8-4f45-9f28-229a8036839b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:27.014342 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d137c2a5-92a8-4f45-9f28-229a8036839b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:27.022575 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d137c2a5-92a8-4f45-9f28-229a8036839b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1513 microversion: 2.1 time: 0.158368 Oct 30 01:03:27.023533 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 502/1020] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:26 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:03:28.046538 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2cb45249-0204-47b0-a6ba-62615fa5ca63 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:28.047141 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2cb45249-0204-47b0-a6ba-62615fa5ca63 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:28.053263 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2cb45249-0204-47b0-a6ba-62615fa5ca63 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:28.053894 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2cb45249-0204-47b0-a6ba-62615fa5ca63 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:28.054330 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2cb45249-0204-47b0-a6ba-62615fa5ca63 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:28.055022 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2cb45249-0204-47b0-a6ba-62615fa5ca63 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:28.055494 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2cb45249-0204-47b0-a6ba-62615fa5ca63 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:28.055905 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2cb45249-0204-47b0-a6ba-62615fa5ca63 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:28.196212 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2cb45249-0204-47b0-a6ba-62615fa5ca63 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:28.203911 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2cb45249-0204-47b0-a6ba-62615fa5ca63 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1515 microversion: 2.1 time: 0.161789 Oct 30 01:03:28.204493 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 519/1021] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:28 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:03:29.229821 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-4520e6d8-1b2b-4e48-bb9d-285c0a64f57e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:29.230444 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-4520e6d8-1b2b-4e48-bb9d-285c0a64f57e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:29.236532 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4520e6d8-1b2b-4e48-bb9d-285c0a64f57e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:29.237021 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4520e6d8-1b2b-4e48-bb9d-285c0a64f57e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:29.237461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4520e6d8-1b2b-4e48-bb9d-285c0a64f57e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:29.238160 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4520e6d8-1b2b-4e48-bb9d-285c0a64f57e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:29.238617 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4520e6d8-1b2b-4e48-bb9d-285c0a64f57e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:29.239046 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4520e6d8-1b2b-4e48-bb9d-285c0a64f57e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:29.416571 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-4520e6d8-1b2b-4e48-bb9d-285c0a64f57e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:29.424178 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-4520e6d8-1b2b-4e48-bb9d-285c0a64f57e tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1571 microversion: 2.1 time: 0.199246 Oct 30 01:03:29.424737 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 503/1022] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:29 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1571 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:03:29.923175 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-7ccae998-c805-476f-9426-b6d9c3785ffd req-293eadef-180c-4e9f-9d79-fae9fcf5d857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f441dbc7-8369-4779-a326-78cbd6e9bc9d", "name": "network-vif-unplugged", "status": "completed", "tag": "f3e3ac4b-534c-4019-98ab-6faab24ef915"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:03:29.935836 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-7ccae998-c805-476f-9426-b6d9c3785ffd req-293eadef-180c-4e9f-9d79-fae9fcf5d857 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:29.936356 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-7ccae998-c805-476f-9426-b6d9c3785ffd req-293eadef-180c-4e9f-9d79-fae9fcf5d857 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:29.937148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-7ccae998-c805-476f-9426-b6d9c3785ffd req-293eadef-180c-4e9f-9d79-fae9fcf5d857 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:29.948561 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-7ccae998-c805-476f-9426-b6d9c3785ffd req-293eadef-180c-4e9f-9d79-fae9fcf5d857 service nova] Creating event network-vif-unplugged:f3e3ac4b-534c-4019-98ab-6faab24ef915 for instance f441dbc7-8369-4779-a326-78cbd6e9bc9d on hv-cinder-86149 Oct 30 01:03:29.953970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-7ccae998-c805-476f-9426-b6d9c3785ffd req-293eadef-180c-4e9f-9d79-fae9fcf5d857 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034496 Oct 30 01:03:29.954558 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 520/1023] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:03:30.449630 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-127d1955-cde3-4bd6-a276-d64b5e16e139 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:30.450243 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-127d1955-cde3-4bd6-a276-d64b5e16e139 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:30.456782 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-127d1955-cde3-4bd6-a276-d64b5e16e139 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:30.457283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-127d1955-cde3-4bd6-a276-d64b5e16e139 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:30.457725 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-127d1955-cde3-4bd6-a276-d64b5e16e139 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:30.458420 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-127d1955-cde3-4bd6-a276-d64b5e16e139 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:30.458901 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-127d1955-cde3-4bd6-a276-d64b5e16e139 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:30.459359 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-127d1955-cde3-4bd6-a276-d64b5e16e139 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:30.587687 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-127d1955-cde3-4bd6-a276-d64b5e16e139 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:30.595754 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-127d1955-cde3-4bd6-a276-d64b5e16e139 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1571 microversion: 2.1 time: 0.152478 Oct 30 01:03:30.596344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 504/1024] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:30 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:03:31.620750 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-e95b3b50-3afa-4b17-b179-d23c817aaaa5 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:31.621365 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-e95b3b50-3afa-4b17-b179-d23c817aaaa5 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:31.628379 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e95b3b50-3afa-4b17-b179-d23c817aaaa5 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:31.628850 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e95b3b50-3afa-4b17-b179-d23c817aaaa5 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:31.629279 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e95b3b50-3afa-4b17-b179-d23c817aaaa5 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:31.629959 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e95b3b50-3afa-4b17-b179-d23c817aaaa5 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:31.630401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e95b3b50-3afa-4b17-b179-d23c817aaaa5 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:31.630877 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e95b3b50-3afa-4b17-b179-d23c817aaaa5 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:31.762083 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e95b3b50-3afa-4b17-b179-d23c817aaaa5 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:31.769731 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-e95b3b50-3afa-4b17-b179-d23c817aaaa5 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1571 microversion: 2.1 time: 0.153408 Oct 30 01:03:31.770287 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 521/1025] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:31 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:03:32.793039 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-0a2f8738-e82f-47e7-8d90-629f04fc3d13 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:32.793638 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-0a2f8738-e82f-47e7-8d90-629f04fc3d13 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:32.800164 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0a2f8738-e82f-47e7-8d90-629f04fc3d13 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:32.800652 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0a2f8738-e82f-47e7-8d90-629f04fc3d13 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:32.801091 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0a2f8738-e82f-47e7-8d90-629f04fc3d13 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:32.801794 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0a2f8738-e82f-47e7-8d90-629f04fc3d13 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:32.802249 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0a2f8738-e82f-47e7-8d90-629f04fc3d13 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:32.802925 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0a2f8738-e82f-47e7-8d90-629f04fc3d13 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:32.935851 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-0a2f8738-e82f-47e7-8d90-629f04fc3d13 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:32.944491 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-0a2f8738-e82f-47e7-8d90-629f04fc3d13 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1571 microversion: 2.1 time: 0.155210 Oct 30 01:03:32.945103 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 505/1026] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:32 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:03:33.968549 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-9cbe37b6-e3ee-4297-9513-46432dcbf53b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:33.969176 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-9cbe37b6-e3ee-4297-9513-46432dcbf53b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:33.975481 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9cbe37b6-e3ee-4297-9513-46432dcbf53b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:33.976955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9cbe37b6-e3ee-4297-9513-46432dcbf53b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:33.977398 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9cbe37b6-e3ee-4297-9513-46432dcbf53b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:33.978065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9cbe37b6-e3ee-4297-9513-46432dcbf53b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:33.978543 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9cbe37b6-e3ee-4297-9513-46432dcbf53b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:33.978957 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9cbe37b6-e3ee-4297-9513-46432dcbf53b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:34.110395 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9cbe37b6-e3ee-4297-9513-46432dcbf53b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:34.118087 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-9cbe37b6-e3ee-4297-9513-46432dcbf53b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1571 microversion: 2.1 time: 0.153703 Oct 30 01:03:34.118639 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 522/1027] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:33 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:03:35.141373 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e9b1dba2-24dc-4e19-bc78-5283b6ad61c0 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:35.141931 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-e9b1dba2-24dc-4e19-bc78-5283b6ad61c0 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:35.148699 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e9b1dba2-24dc-4e19-bc78-5283b6ad61c0 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:35.149181 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e9b1dba2-24dc-4e19-bc78-5283b6ad61c0 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:35.149614 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e9b1dba2-24dc-4e19-bc78-5283b6ad61c0 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:35.150314 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e9b1dba2-24dc-4e19-bc78-5283b6ad61c0 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:35.150773 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e9b1dba2-24dc-4e19-bc78-5283b6ad61c0 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:35.151195 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e9b1dba2-24dc-4e19-bc78-5283b6ad61c0 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:35.291222 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-e9b1dba2-24dc-4e19-bc78-5283b6ad61c0 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:35.298854 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e9b1dba2-24dc-4e19-bc78-5283b6ad61c0 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1571 microversion: 2.1 time: 0.161459 Oct 30 01:03:35.299404 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 506/1028] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:35 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:03:36.322858 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-86fa3d31-11b2-4f22-8a91-ffad95a84c60 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:36.323481 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-86fa3d31-11b2-4f22-8a91-ffad95a84c60 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:36.329938 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-86fa3d31-11b2-4f22-8a91-ffad95a84c60 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:36.330406 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-86fa3d31-11b2-4f22-8a91-ffad95a84c60 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:36.330828 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-86fa3d31-11b2-4f22-8a91-ffad95a84c60 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:36.331504 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-86fa3d31-11b2-4f22-8a91-ffad95a84c60 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:36.331949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-86fa3d31-11b2-4f22-8a91-ffad95a84c60 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:36.332407 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-86fa3d31-11b2-4f22-8a91-ffad95a84c60 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:36.583522 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-86fa3d31-11b2-4f22-8a91-ffad95a84c60 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:36.592100 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-86fa3d31-11b2-4f22-8a91-ffad95a84c60 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1571 microversion: 2.1 time: 0.273238 Oct 30 01:03:36.592669 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 523/1029] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:36 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1571 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:03:37.614904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-79b9448c-c72c-4ca6-a496-807361de5e8b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:37.615549 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-79b9448c-c72c-4ca6-a496-807361de5e8b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:37.621478 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-79b9448c-c72c-4ca6-a496-807361de5e8b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:37.621949 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-79b9448c-c72c-4ca6-a496-807361de5e8b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:37.622375 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-79b9448c-c72c-4ca6-a496-807361de5e8b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:37.623055 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-79b9448c-c72c-4ca6-a496-807361de5e8b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:37.623499 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-79b9448c-c72c-4ca6-a496-807361de5e8b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:37.623914 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-79b9448c-c72c-4ca6-a496-807361de5e8b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:37.753787 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-79b9448c-c72c-4ca6-a496-807361de5e8b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:37.762397 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-79b9448c-c72c-4ca6-a496-807361de5e8b tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1571 microversion: 2.1 time: 0.151516 Oct 30 01:03:37.762946 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 507/1030] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:37 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:03:38.786076 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-034ab956-b578-4277-b0ed-ece823aa05f9 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:03:38.786618 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-034ab956-b578-4277-b0ed-ece823aa05f9 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:03:38.793997 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-034ab956-b578-4277-b0ed-ece823aa05f9 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:38.794473 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-034ab956-b578-4277-b0ed-ece823aa05f9 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:38.794928 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-034ab956-b578-4277-b0ed-ece823aa05f9 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:38.795608 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-034ab956-b578-4277-b0ed-ece823aa05f9 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:38.796053 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-034ab956-b578-4277-b0ed-ece823aa05f9 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:38.796492 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-034ab956-b578-4277-b0ed-ece823aa05f9 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:38.925674 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-034ab956-b578-4277-b0ed-ece823aa05f9 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:03:38.934065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-034ab956-b578-4277-b0ed-ece823aa05f9 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1558 microversion: 2.1 time: 0.151957 Oct 30 01:03:38.934619 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 524/1031] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:03:38 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:03:39.983891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-f9fe18d1-c2a6-4cba-acfb-4b68a19f1b80 req-38629bb2-9942-4b00-8af0-15bf90df30f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f441dbc7-8369-4779-a326-78cbd6e9bc9d", "name": "network-vif-plugged", "status": "completed", "tag": "f3e3ac4b-534c-4019-98ab-6faab24ef915"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:03:39.994339 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-f9fe18d1-c2a6-4cba-acfb-4b68a19f1b80 req-38629bb2-9942-4b00-8af0-15bf90df30f4 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:03:39.994893 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-f9fe18d1-c2a6-4cba-acfb-4b68a19f1b80 req-38629bb2-9942-4b00-8af0-15bf90df30f4 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:03:39.995376 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-f9fe18d1-c2a6-4cba-acfb-4b68a19f1b80 req-38629bb2-9942-4b00-8af0-15bf90df30f4 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:03:40.008296 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-f9fe18d1-c2a6-4cba-acfb-4b68a19f1b80 req-38629bb2-9942-4b00-8af0-15bf90df30f4 service nova] Creating event network-vif-plugged:f3e3ac4b-534c-4019-98ab-6faab24ef915 for instance f441dbc7-8369-4779-a326-78cbd6e9bc9d on hv-cinder-86149 Oct 30 01:03:40.013496 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-f9fe18d1-c2a6-4cba-acfb-4b68a19f1b80 req-38629bb2-9942-4b00-8af0-15bf90df30f4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033313 Oct 30 01:03:40.014415 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 508/1032] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:04:05.057243 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:05.057978 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:05.106904 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-eb4781bd-35ae-48da-af65-066a46d103a4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:05.107394 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-eb4781bd-35ae-48da-af65-066a46d103a4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:04:05.113461 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-eb4781bd-35ae-48da-af65-066a46d103a4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:05.113936 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-eb4781bd-35ae-48da-af65-066a46d103a4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:05.114365 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-eb4781bd-35ae-48da-af65-066a46d103a4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:05.115047 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-eb4781bd-35ae-48da-af65-066a46d103a4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:05.115498 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-eb4781bd-35ae-48da-af65-066a46d103a4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:05.115917 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-eb4781bd-35ae-48da-af65-066a46d103a4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:05.139175 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-eb4781bd-35ae-48da-af65-066a46d103a4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36/ips" status: 200 len: 149 microversion: 2.1 time: 0.086807 Oct 30 01:04:05.139653 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 525/1033] 10.222.0.36 () {58 vars in 1248 bytes} [Sun Oct 30 01:04:05 2022] GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36/ips => generated 149 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:04:06.478849 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-2c254bb9-2425-46b3-be99-d08f7e733410 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f6cec35-b2b9-4509-98cb-632cf266e3ec"}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:06.481443 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-2c254bb9-2425-46b3-be99-d08f7e733410 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:04:06.483763 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=28 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:06.484442 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:06.490688 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2c254bb9-2425-46b3-be99-d08f7e733410 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:06.491170 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2c254bb9-2425-46b3-be99-d08f7e733410 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:06.491606 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2c254bb9-2425-46b3-be99-d08f7e733410 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:06.492329 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2c254bb9-2425-46b3-be99-d08f7e733410 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:06.492785 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2c254bb9-2425-46b3-be99-d08f7e733410 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:06.493211 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2c254bb9-2425-46b3-be99-d08f7e733410 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:06.753942 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-2c254bb9-2425-46b3-be99-d08f7e733410 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "POST /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278942 Oct 30 01:04:06.754551 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 509/1034] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Oct 30 01:04:06 2022] POST /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:04:14.300476 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f3eb9657-b359-49e4-8621-de765b44cec2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f6cec35-b2b9-4509-98cb-632cf266e3ec"}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:14.302969 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-f3eb9657-b359-49e4-8621-de765b44cec2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:04:14.309557 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f3eb9657-b359-49e4-8621-de765b44cec2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:14.310032 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f3eb9657-b359-49e4-8621-de765b44cec2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:14.310460 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f3eb9657-b359-49e4-8621-de765b44cec2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:14.311141 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f3eb9657-b359-49e4-8621-de765b44cec2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:14.311585 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f3eb9657-b359-49e4-8621-de765b44cec2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:14.311997 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f3eb9657-b359-49e4-8621-de765b44cec2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:14.389121 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-f3eb9657-b359-49e4-8621-de765b44cec2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] HTTP exception thrown: Invalid volume: volume 6f6cec35-b2b9-4509-98cb-632cf266e3ec is already attached to instances: c5dcd920-bcaa-4627-9732-fbc5032e7c36 Oct 30 01:04:14.390970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f3eb9657-b359-49e4-8621-de765b44cec2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Request method failure captured: Oct 30 01:04:14.390970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: POST /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36/os-volume_attachments HTTP/1.1 Oct 30 01:04:14.390970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 01:04:14.390970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 01:04:14.390970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 01:04:14.390970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 74 Oct 30 01:04:14.390970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 01:04:14.390970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 01:04:14.390970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 01:04:14.390970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 01:04:14.390970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcxY8meP6vvhjbMl5SDegLis0GNSJ-as78-NEFrPY5visYG6nAB9FJqsqSnKlmkLjDyOiz2t_9jR7dQbTJVad7Ot58e6fXvOwVA87-vsO9JQuc5io49RaVNBH3eRFW0SDeH6mC7M6KHqZYWVfoplDjyGh6d_VPsrjSppQ78VV6m9NHw Oct 30 01:04:14.390970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 01:04:14.390970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 01:04:14.390970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 01:04:14.390970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 01:04:14.390970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 01:04:14.390970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 01:04:14.390970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:04:14.390970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:04:14.390970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 01:04:14.390970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 01:04:14.392710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:04:14.392710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:04:14.392710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:04:14.392710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:04:14.392710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:04:14.392710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 01:04:14.392710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 01:04:14.392710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 7353722ccb7548a6b92c89d4917fefaa Oct 30 01:04:14.392710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:04:14.392710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Oct 30 01:04:14.392710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {"volumeAttachment": {"volumeId": "6f6cec35-b2b9-4509-98cb-632cf266e3ec"}} Oct 30 01:04:14.392710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 01:04:14.393670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Invalid volume: volume 6f6cec35-b2b9-4509-98cb-632cf266e3ec is already attached to instances: c5dcd920-bcaa-4627-9732-fbc5032e7c36 Oct 30 01:04:14.393670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'server_id': 'c5dcd920-bcaa-4627-9732-fbc5032e7c36', 'body': {'volumeAttachment': {'volumeId': '6f6cec35-b2b9-4509-98cb-632cf266e3ec'}}} Oct 30 01:04:14.393670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:04:14.393670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:04:14.393670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 30 01:04:14.393670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 30 01:04:14.393670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 30 01:04:14.393670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 30 01:04:14.393670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 30 01:04:14.393670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 30 01:04:14.393670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 30 01:04:14.393670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 30 01:04:14.393670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 30 01:04:14.393670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 30 01:04:14.393670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6f6cec35-b2b9-4509-98cb-632cf266e3ec is already attached to instances: c5dcd920-bcaa-4627-9732-fbc5032e7c36 Oct 30 01:04:14.393670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:04:14.393670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:04:14.393670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:04:14.393670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:04:14.395840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:04:14.395840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:04:14.395840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:04:14.395840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:04:14.395840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:04:14.395840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:04:14.395840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:04:14.395840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:04:14.395840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:04:14.395840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:04:14.395840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 30 01:04:14.395840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 30 01:04:14.395840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 30 01:04:14.395840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 30 01:04:14.395840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6f6cec35-b2b9-4509-98cb-632cf266e3ec is already attached to instances: c5dcd920-bcaa-4627-9732-fbc5032e7c36 Oct 30 01:04:14.395840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:04:14.395840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:04:14.395840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:04:14.395840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:04:14.395840 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:04:14.397502 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:04:14.397502 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:04:14.397502 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:04:14.397502 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6f6cec35-b2b9-4509-98cb-632cf266e3ec is already attached to instances: c5dcd920-bcaa-4627-9732-fbc5032e7c36 Oct 30 01:04:14.397502 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:04:14.397502 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f3eb9657-b359-49e4-8621-de765b44cec2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Returning 400 to user: Invalid volume: volume 6f6cec35-b2b9-4509-98cb-632cf266e3ec is already attached to instances: c5dcd920-bcaa-4627-9732-fbc5032e7c36 {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:04:14.397502 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-f3eb9657-b359-49e4-8621-de765b44cec2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "POST /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096200 Oct 30 01:04:14.397502 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 526/1035] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Oct 30 01:04:14 2022] POST /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 30 01:04:14.460326 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-034b60a8-8ec9-4066-996b-653c5e7a3920 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:14.460906 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-034b60a8-8ec9-4066-996b-653c5e7a3920 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:04:14.467351 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-034b60a8-8ec9-4066-996b-653c5e7a3920 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:14.467825 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-034b60a8-8ec9-4066-996b-653c5e7a3920 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:14.468294 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-034b60a8-8ec9-4066-996b-653c5e7a3920 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:14.468978 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-034b60a8-8ec9-4066-996b-653c5e7a3920 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:14.469424 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-034b60a8-8ec9-4066-996b-653c5e7a3920 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:14.469841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-034b60a8-8ec9-4066-996b-653c5e7a3920 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:14.550385 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.objects.instance [None req-034b60a8-8ec9-4066-996b-653c5e7a3920 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lazy-loading 'services' on Instance uuid c5dcd920-bcaa-4627-9732-fbc5032e7c36 {{(pid=125553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:04:14.621887 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-034b60a8-8ec9-4066-996b-653c5e7a3920 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36/os-volume_attachments/6f6cec35-b2b9-4509-98cb-632cf266e3ec" status: 202 len: 0 microversion: 2.1 time: 0.168102 Oct 30 01:04:14.622459 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 510/1036] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Oct 30 01:04:14 2022] DELETE /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36/os-volume_attachments/6f6cec35-b2b9-4509-98cb-632cf266e3ec => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:04:14.631858 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-cddd1589-2bf9-49c7-bd99-463edd29cfe5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:14.634080 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-cddd1589-2bf9-49c7-bd99-463edd29cfe5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:04:14.640751 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cddd1589-2bf9-49c7-bd99-463edd29cfe5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:14.641233 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cddd1589-2bf9-49c7-bd99-463edd29cfe5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:14.641669 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cddd1589-2bf9-49c7-bd99-463edd29cfe5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:14.642516 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cddd1589-2bf9-49c7-bd99-463edd29cfe5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:14.642972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cddd1589-2bf9-49c7-bd99-463edd29cfe5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:14.643404 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cddd1589-2bf9-49c7-bd99-463edd29cfe5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:14.673574 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-cddd1589-2bf9-49c7-bd99-463edd29cfe5 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046576 Oct 30 01:04:14.674124 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 527/1037] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Oct 30 01:04:14 2022] GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:04:15.687767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-6d0d0acd-edc7-4f88-b038-e492fd1ab3e6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:15.690099 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-6d0d0acd-edc7-4f88-b038-e492fd1ab3e6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:04:15.696433 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6d0d0acd-edc7-4f88-b038-e492fd1ab3e6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:15.696919 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6d0d0acd-edc7-4f88-b038-e492fd1ab3e6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:15.697351 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6d0d0acd-edc7-4f88-b038-e492fd1ab3e6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:15.698040 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6d0d0acd-edc7-4f88-b038-e492fd1ab3e6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:15.698493 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6d0d0acd-edc7-4f88-b038-e492fd1ab3e6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:15.698916 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-6d0d0acd-edc7-4f88-b038-e492fd1ab3e6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:15.728997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-6d0d0acd-edc7-4f88-b038-e492fd1ab3e6 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046161 Oct 30 01:04:15.729544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 511/1038] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Oct 30 01:04:15 2022] GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:04:15.794299 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-6dce5867-5ae2-4cc4-9370-7be099ff2098 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:15.794834 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-6dce5867-5ae2-4cc4-9370-7be099ff2098 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:04:15.801798 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6dce5867-5ae2-4cc4-9370-7be099ff2098 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:15.802275 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6dce5867-5ae2-4cc4-9370-7be099ff2098 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:15.802707 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6dce5867-5ae2-4cc4-9370-7be099ff2098 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:15.803395 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6dce5867-5ae2-4cc4-9370-7be099ff2098 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:15.803844 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6dce5867-5ae2-4cc4-9370-7be099ff2098 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:15.804306 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6dce5867-5ae2-4cc4-9370-7be099ff2098 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:15.829318 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-6dce5867-5ae2-4cc4-9370-7be099ff2098 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Going to try to terminate instance {{(pid=125554) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:04:15.906784 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-6dce5867-5ae2-4cc4-9370-7be099ff2098 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36" status: 204 len: 0 microversion: 2.1 time: 0.117067 Oct 30 01:04:15.907680 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 528/1039] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 01:04:15 2022] DELETE /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:04:15.915967 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3c3b25eb-222a-4055-a569-50e9c997d3a8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:15.916615 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-3c3b25eb-222a-4055-a569-50e9c997d3a8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:04:15.922531 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3c3b25eb-222a-4055-a569-50e9c997d3a8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:15.923011 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3c3b25eb-222a-4055-a569-50e9c997d3a8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:15.923447 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3c3b25eb-222a-4055-a569-50e9c997d3a8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:15.924163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3c3b25eb-222a-4055-a569-50e9c997d3a8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:15.924640 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3c3b25eb-222a-4055-a569-50e9c997d3a8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:15.925305 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-3c3b25eb-222a-4055-a569-50e9c997d3a8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:16.056475 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3c3b25eb-222a-4055-a569-50e9c997d3a8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:04:16.064475 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-3c3b25eb-222a-4055-a569-50e9c997d3a8 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36" status: 200 len: 1681 microversion: 2.1 time: 0.152397 Oct 30 01:04:16.065034 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 512/1040] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:04:15 2022] GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:04:17.089249 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-a19cedd6-5192-4169-8754-fd0761f126d4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:17.089967 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-a19cedd6-5192-4169-8754-fd0761f126d4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:04:17.096257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a19cedd6-5192-4169-8754-fd0761f126d4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:17.097809 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a19cedd6-5192-4169-8754-fd0761f126d4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:17.098246 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a19cedd6-5192-4169-8754-fd0761f126d4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:17.098932 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a19cedd6-5192-4169-8754-fd0761f126d4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:17.099378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a19cedd6-5192-4169-8754-fd0761f126d4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:17.099796 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a19cedd6-5192-4169-8754-fd0761f126d4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:17.229008 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-a19cedd6-5192-4169-8754-fd0761f126d4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:04:17.236677 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-a19cedd6-5192-4169-8754-fd0761f126d4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36" status: 200 len: 1681 microversion: 2.1 time: 0.151953 Oct 30 01:04:17.237381 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 529/1041] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:04:17 2022] GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:04:18.260107 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5126d262-c2cb-4d56-aa3b-c9b344bacb8e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:18.260725 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5126d262-c2cb-4d56-aa3b-c9b344bacb8e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:04:18.268165 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5126d262-c2cb-4d56-aa3b-c9b344bacb8e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:18.268165 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5126d262-c2cb-4d56-aa3b-c9b344bacb8e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:18.269361 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5126d262-c2cb-4d56-aa3b-c9b344bacb8e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:18.270076 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5126d262-c2cb-4d56-aa3b-c9b344bacb8e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:18.270534 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5126d262-c2cb-4d56-aa3b-c9b344bacb8e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:18.271144 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5126d262-c2cb-4d56-aa3b-c9b344bacb8e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:18.380196 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5126d262-c2cb-4d56-aa3b-c9b344bacb8e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:04:18.387848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5126d262-c2cb-4d56-aa3b-c9b344bacb8e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36" status: 200 len: 1613 microversion: 2.1 time: 0.131709 Oct 30 01:04:18.388439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 513/1042] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:04:18 2022] GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36 => generated 1613 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:04:18.609744 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-dac50b49-42cb-484d-be0f-f6814c7e6954 req-81fdb9cb-e328-4a40-acbd-43635884c27d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5dcd920-bcaa-4627-9732-fbc5032e7c36", "name": "network-vif-deleted", "tag": "0afb6a7a-03c6-479e-90fb-5bcc257d9d36"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:18.620758 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-dac50b49-42cb-484d-be0f-f6814c7e6954 req-81fdb9cb-e328-4a40-acbd-43635884c27d service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:18.621236 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-dac50b49-42cb-484d-be0f-f6814c7e6954 req-81fdb9cb-e328-4a40-acbd-43635884c27d service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:18.621663 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-dac50b49-42cb-484d-be0f-f6814c7e6954 req-81fdb9cb-e328-4a40-acbd-43635884c27d service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:18.634221 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-dac50b49-42cb-484d-be0f-f6814c7e6954 req-81fdb9cb-e328-4a40-acbd-43635884c27d service nova] Creating event network-vif-deleted:0afb6a7a-03c6-479e-90fb-5bcc257d9d36 for instance c5dcd920-bcaa-4627-9732-fbc5032e7c36 on hv-cinder-86149 Oct 30 01:04:18.639309 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-dac50b49-42cb-484d-be0f-f6814c7e6954 req-81fdb9cb-e328-4a40-acbd-43635884c27d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033222 Oct 30 01:04:18.640220 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 530/1043] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:04:19.412816 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e80ae85c-6f32-4693-b074-8af7fef41aaf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:19.413433 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-e80ae85c-6f32-4693-b074-8af7fef41aaf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:04:19.420126 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e80ae85c-6f32-4693-b074-8af7fef41aaf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:19.420835 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e80ae85c-6f32-4693-b074-8af7fef41aaf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:19.421274 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e80ae85c-6f32-4693-b074-8af7fef41aaf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:19.421983 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e80ae85c-6f32-4693-b074-8af7fef41aaf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:19.422443 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e80ae85c-6f32-4693-b074-8af7fef41aaf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:19.422875 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e80ae85c-6f32-4693-b074-8af7fef41aaf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:19.436876 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-e80ae85c-6f32-4693-b074-8af7fef41aaf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] HTTP exception thrown: Instance c5dcd920-bcaa-4627-9732-fbc5032e7c36 could not be found. Oct 30 01:04:19.438813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e80ae85c-6f32-4693-b074-8af7fef41aaf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Request method failure captured: Oct 30 01:04:19.438813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36 HTTP/1.1 Oct 30 01:04:19.438813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 01:04:19.438813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 01:04:19.438813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 01:04:19.438813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 01:04:19.438813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 01:04:19.438813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 01:04:19.438813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 01:04:19.438813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 01:04:19.438813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXcxY8meP6vvhjbMl5SDegLis0GNSJ-as78-NEFrPY5visYG6nAB9FJqsqSnKlmkLjDyOiz2t_9jR7dQbTJVad7Ot58e6fXvOwVA87-vsO9JQuc5io49RaVNBH3eRFW0SDeH6mC7M6KHqZYWVfoplDjyGh6d_VPsrjSppQ78VV6m9NHw Oct 30 01:04:19.438813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 01:04:19.438813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 01:04:19.438813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 01:04:19.438813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 01:04:19.438813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 01:04:19.438813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 01:04:19.438813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:04:19.438813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:04:19.438813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 01:04:19.438813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 01:04:19.440673 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:04:19.440673 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:04:19.440673 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:04:19.440673 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:04:19.440673 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:04:19.440673 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 01:04:19.440673 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 01:04:19.440673 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: 7353722ccb7548a6b92c89d4917fefaa Oct 30 01:04:19.440673 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:04:19.440673 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: > Oct 30 01:04:19.440673 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Instance c5dcd920-bcaa-4627-9732-fbc5032e7c36 could not be found. Oct 30 01:04:19.440673 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': 'c5dcd920-bcaa-4627-9732-fbc5032e7c36'} Oct 30 01:04:19.441921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:04:19.441921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:04:19.441921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:04:19.441921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:04:19.441921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:04:19.441921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:04:19.441921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:04:19.441921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:04:19.441921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:04:19.441921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:04:19.441921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5dcd920-bcaa-4627-9732-fbc5032e7c36 could not be found. Oct 30 01:04:19.441921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:04:19.441921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:04:19.441921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:04:19.441921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:04:19.441921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:04:19.441921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:04:19.441921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:04:19.441921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:04:19.441921 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:04:19.443446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:04:19.443446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:04:19.443446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:04:19.443446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:04:19.443446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:04:19.443446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:04:19.443446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:04:19.443446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5dcd920-bcaa-4627-9732-fbc5032e7c36 could not be found. Oct 30 01:04:19.443446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:04:19.443446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:04:19.443446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:04:19.443446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:04:19.443446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:04:19.443446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:04:19.443446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:04:19.443446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:04:19.443446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5dcd920-bcaa-4627-9732-fbc5032e7c36 could not be found. Oct 30 01:04:19.443446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:04:19.445229 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e80ae85c-6f32-4693-b074-8af7fef41aaf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Returning 404 to user: Instance c5dcd920-bcaa-4627-9732-fbc5032e7c36 could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:04:19.445229 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e80ae85c-6f32-4693-b074-8af7fef41aaf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36" status: 404 len: 111 microversion: 2.1 time: 0.032032 Oct 30 01:04:19.445229 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 514/1044] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:04:19 2022] GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:04:19.451029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ed713cb3-a445-4e2f-b998-8e9bd0ffa787 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '.version_select at 0x7faf79327700>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:19.472464 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ed713cb3-a445-4e2f-b998-8e9bd0ffa787 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1759263414" status: 202 len: 0 microversion: 2.1 time: 0.025354 Oct 30 01:04:19.473319 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 531/1045] 10.222.0.36 () {58 vars in 1221 bytes} [Sun Oct 30 01:04:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1759263414 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:04:20.077093 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-7fbefb4b-a077-4e33-921a-2f7bf51b3b2c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Action: 'create', calling method: .version_select at 0x7faf75b22820>, body: {"keypair": {"name": "tempest-keypair-522933993", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMS5CT9s42X5NlU5K6Gmj2kmcoFwmJh+kqiEuUIe4sV9TmJBkd2GIH+iXOMt0tZ3QVOOYv03AC0MLPg5Umoz4WevMU0tyi61RoBxCxBeck3NxA+Ln/D7Bq0r/Kdj9KmftA=="}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:20.093215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-7fbefb4b-a077-4e33-921a-2f7bf51b3b2c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Getting quotas for project dc70ef555fc84a51b3521007d00b77e3. Resources: {'key_pairs'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:04:20.097544 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-7fbefb4b-a077-4e33-921a-2f7bf51b3b2c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Getting quotas for user 7353722ccb7548a6b92c89d4917fefaa and project dc70ef555fc84a51b3521007d00b77e3. Resources: {'key_pairs'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:04:20.118566 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-7fbefb4b-a077-4e33-921a-2f7bf51b3b2c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045526 Oct 30 01:04:20.119141 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 515/1046] 10.222.0.36 () {60 vars in 1159 bytes} [Sun Oct 30 01:04:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:04:21.562884 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-84cee2bf-5e78-4dab-a2b2-349199d2e438 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1887127797", "imageRef": "27983dee-4bd6-4aad-9c28-22bd5382709a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c4c02ee-d590-4828-8332-2711b92b38f9"}], "security_groups": [{"name": "tempest-securitygroup--1816416338"}], "key_name": "tempest-keypair-522933993", "user_data": "}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:21.666507 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.network.neutron [None req-84cee2bf-5e78-4dab-a2b2-349199d2e438 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] validate_networks() for [('8c4c02ee-d590-4828-8332-2711b92b38f9', None, None, None, None, None)] {{(pid=125554) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:04:22.077215 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-84cee2bf-5e78-4dab-a2b2-349199d2e438 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Flavor limits 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:04:22.077636 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-84cee2bf-5e78-4dab-a2b2-349199d2e438 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Image limits 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:04:22.078109 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-84cee2bf-5e78-4dab-a2b2-349199d2e438 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Flavor pref 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:04:22.078517 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-84cee2bf-5e78-4dab-a2b2-349199d2e438 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Image pref 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:04:22.078931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-84cee2bf-5e78-4dab-a2b2-349199d2e438 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:04:22.088535 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-84cee2bf-5e78-4dab-a2b2-349199d2e438 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:22.089015 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-84cee2bf-5e78-4dab-a2b2-349199d2e438 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:22.089451 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-84cee2bf-5e78-4dab-a2b2-349199d2e438 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:22.090177 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-84cee2bf-5e78-4dab-a2b2-349199d2e438 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:22.090634 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-84cee2bf-5e78-4dab-a2b2-349199d2e438 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:22.091060 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-84cee2bf-5e78-4dab-a2b2-349199d2e438 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:22.107348 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-84cee2bf-5e78-4dab-a2b2-349199d2e438 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Getting quotas for project dc70ef555fc84a51b3521007d00b77e3. Resources: {'instances', 'cores', 'ram'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:04:22.111788 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-84cee2bf-5e78-4dab-a2b2-349199d2e438 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Getting quotas for user 7353722ccb7548a6b92c89d4917fefaa and project dc70ef555fc84a51b3521007d00b77e3. Resources: {'instances', 'cores', 'ram'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:04:22.122814 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-84cee2bf-5e78-4dab-a2b2-349199d2e438 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Going to run 1 instances... {{(pid=125554) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:04:22.125209 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-84cee2bf-5e78-4dab-a2b2-349199d2e438 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='27983dee-4bd6-4aad-9c28-22bd5382709a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125554) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:04:22.172483 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-84cee2bf-5e78-4dab-a2b2-349199d2e438 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.614379 Oct 30 01:04:22.173120 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 532/1047] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Oct 30 01:04:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:04:22.185334 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d8c37e9e-486a-41fe-825e-a32b7e1203ee tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:22.185970 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d8c37e9e-486a-41fe-825e-a32b7e1203ee tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:04:22.245030 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d8c37e9e-486a-41fe-825e-a32b7e1203ee tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:04:22.251863 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d8c37e9e-486a-41fe-825e-a32b7e1203ee tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b" status: 200 len: 1241 microversion: 2.1 time: 0.070993 Oct 30 01:04:22.253052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 516/1048] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:04:22 2022] GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:04:23.280548 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-e6c9be4b-9023-4193-9293-0b5b92673d31 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:23.281689 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-e6c9be4b-9023-4193-9293-0b5b92673d31 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:04:23.294048 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e6c9be4b-9023-4193-9293-0b5b92673d31 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:23.294914 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e6c9be4b-9023-4193-9293-0b5b92673d31 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:23.295750 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e6c9be4b-9023-4193-9293-0b5b92673d31 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:23.297051 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e6c9be4b-9023-4193-9293-0b5b92673d31 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:23.298107 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e6c9be4b-9023-4193-9293-0b5b92673d31 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:23.299479 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e6c9be4b-9023-4193-9293-0b5b92673d31 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:23.441351 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e6c9be4b-9023-4193-9293-0b5b92673d31 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:04:23.450259 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-e6c9be4b-9023-4193-9293-0b5b92673d31 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b" status: 200 len: 1301 microversion: 2.1 time: 0.178045 Oct 30 01:04:23.450824 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 533/1049] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:04:23 2022] GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b => generated 1301 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:04:24.474813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-433c8e4b-2538-4cff-b027-8a134f3c3700 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:24.475478 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-433c8e4b-2538-4cff-b027-8a134f3c3700 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:04:24.481900 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-433c8e4b-2538-4cff-b027-8a134f3c3700 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:24.482380 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-433c8e4b-2538-4cff-b027-8a134f3c3700 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:24.482809 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-433c8e4b-2538-4cff-b027-8a134f3c3700 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:24.483505 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-433c8e4b-2538-4cff-b027-8a134f3c3700 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:24.483963 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-433c8e4b-2538-4cff-b027-8a134f3c3700 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:24.484411 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-433c8e4b-2538-4cff-b027-8a134f3c3700 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:24.684096 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-433c8e4b-2538-4cff-b027-8a134f3c3700 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:04:24.693305 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-433c8e4b-2538-4cff-b027-8a134f3c3700 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b" status: 200 len: 1367 microversion: 2.1 time: 0.222959 Oct 30 01:04:24.708926 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 517/1050] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:04:24 2022] GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:04:24.981453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-053992ae-d15a-4ef7-8259-c4c1f55f10a6 req-fe1e5305-5631-4021-9a1e-e1dc1a6237d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "975c9084-63da-4d0a-8d00-c5826621627b", "tag": "ada45337-1d35-4c58-8683-4af5501e111e"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:24.993283 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-053992ae-d15a-4ef7-8259-c4c1f55f10a6 req-fe1e5305-5631-4021-9a1e-e1dc1a6237d6 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:24.993847 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-053992ae-d15a-4ef7-8259-c4c1f55f10a6 req-fe1e5305-5631-4021-9a1e-e1dc1a6237d6 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:24.994366 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-053992ae-d15a-4ef7-8259-c4c1f55f10a6 req-fe1e5305-5631-4021-9a1e-e1dc1a6237d6 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:25.006051 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-053992ae-d15a-4ef7-8259-c4c1f55f10a6 req-fe1e5305-5631-4021-9a1e-e1dc1a6237d6 service nova] Creating event network-changed:ada45337-1d35-4c58-8683-4af5501e111e for instance 975c9084-63da-4d0a-8d00-c5826621627b on hv-cinder-86149 Oct 30 01:04:25.011034 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-053992ae-d15a-4ef7-8259-c4c1f55f10a6 req-fe1e5305-5631-4021-9a1e-e1dc1a6237d6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033504 Oct 30 01:04:25.011624 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 534/1051] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:04:25.717382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-b217b783-b824-4b37-825d-b24a455768d2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:25.717987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-b217b783-b824-4b37-825d-b24a455768d2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:04:25.724656 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b217b783-b824-4b37-825d-b24a455768d2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:25.725131 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b217b783-b824-4b37-825d-b24a455768d2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:25.725557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b217b783-b824-4b37-825d-b24a455768d2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:25.726243 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b217b783-b824-4b37-825d-b24a455768d2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:25.726688 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b217b783-b824-4b37-825d-b24a455768d2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:25.727103 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b217b783-b824-4b37-825d-b24a455768d2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:25.859850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-b217b783-b824-4b37-825d-b24a455768d2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:04:25.868159 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-b217b783-b824-4b37-825d-b24a455768d2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b" status: 200 len: 1367 microversion: 2.1 time: 0.154632 Oct 30 01:04:25.868714 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 518/1052] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:04:25 2022] GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:04:26.893352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-79269847-8317-4508-bced-1df23d237e13 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:26.894030 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-79269847-8317-4508-bced-1df23d237e13 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:04:26.900329 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-79269847-8317-4508-bced-1df23d237e13 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:26.900809 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-79269847-8317-4508-bced-1df23d237e13 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:26.901242 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-79269847-8317-4508-bced-1df23d237e13 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:26.901929 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-79269847-8317-4508-bced-1df23d237e13 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:26.902412 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-79269847-8317-4508-bced-1df23d237e13 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:26.902831 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-79269847-8317-4508-bced-1df23d237e13 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:27.033899 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-79269847-8317-4508-bced-1df23d237e13 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:04:27.041839 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-79269847-8317-4508-bced-1df23d237e13 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b" status: 200 len: 1367 microversion: 2.1 time: 0.153423 Oct 30 01:04:27.042406 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 535/1053] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:04:26 2022] GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:04:28.065321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1c713e7d-c218-418d-91ea-c5f231661de3 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:28.065923 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1c713e7d-c218-418d-91ea-c5f231661de3 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:04:28.072537 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1c713e7d-c218-418d-91ea-c5f231661de3 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:28.073029 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1c713e7d-c218-418d-91ea-c5f231661de3 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:28.073466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1c713e7d-c218-418d-91ea-c5f231661de3 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:28.074176 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1c713e7d-c218-418d-91ea-c5f231661de3 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:28.074632 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1c713e7d-c218-418d-91ea-c5f231661de3 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:28.075060 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1c713e7d-c218-418d-91ea-c5f231661de3 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:28.214626 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1c713e7d-c218-418d-91ea-c5f231661de3 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:04:28.223610 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1c713e7d-c218-418d-91ea-c5f231661de3 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b" status: 200 len: 1367 microversion: 2.1 time: 0.162676 Oct 30 01:04:28.224206 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 519/1054] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:04:28 2022] GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:04:29.246792 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-09bdafcc-8892-4560-98ab-87a6d961e77e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:29.247396 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-09bdafcc-8892-4560-98ab-87a6d961e77e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:04:29.254394 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-09bdafcc-8892-4560-98ab-87a6d961e77e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:29.254870 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-09bdafcc-8892-4560-98ab-87a6d961e77e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:29.255305 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-09bdafcc-8892-4560-98ab-87a6d961e77e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:29.255998 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-09bdafcc-8892-4560-98ab-87a6d961e77e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:29.256486 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-09bdafcc-8892-4560-98ab-87a6d961e77e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:29.256905 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-09bdafcc-8892-4560-98ab-87a6d961e77e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:29.387556 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-09bdafcc-8892-4560-98ab-87a6d961e77e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:04:29.395326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-09bdafcc-8892-4560-98ab-87a6d961e77e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b" status: 200 len: 1367 microversion: 2.1 time: 0.152390 Oct 30 01:04:29.395880 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 536/1055] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:04:29 2022] GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:04:30.385608 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-5a005fad-43e9-4f4a-b9b0-5e8bbeea36e5 req-d8fbf971-2ff1-46c7-9ae4-cbebb996691a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "975c9084-63da-4d0a-8d00-c5826621627b", "name": "network-vif-plugged", "status": "completed", "tag": "ada45337-1d35-4c58-8683-4af5501e111e"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:30.397827 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-5a005fad-43e9-4f4a-b9b0-5e8bbeea36e5 req-d8fbf971-2ff1-46c7-9ae4-cbebb996691a service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:30.398322 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-5a005fad-43e9-4f4a-b9b0-5e8bbeea36e5 req-d8fbf971-2ff1-46c7-9ae4-cbebb996691a service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:30.398754 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-5a005fad-43e9-4f4a-b9b0-5e8bbeea36e5 req-d8fbf971-2ff1-46c7-9ae4-cbebb996691a service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:30.409922 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-5a005fad-43e9-4f4a-b9b0-5e8bbeea36e5 req-d8fbf971-2ff1-46c7-9ae4-cbebb996691a service nova] Creating event network-vif-plugged:ada45337-1d35-4c58-8683-4af5501e111e for instance 975c9084-63da-4d0a-8d00-c5826621627b on hv-cinder-86149 Oct 30 01:04:30.414954 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-5a005fad-43e9-4f4a-b9b0-5e8bbeea36e5 req-d8fbf971-2ff1-46c7-9ae4-cbebb996691a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033087 Oct 30 01:04:30.415800 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 520/1056] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:04:30.419054 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-bb905777-01ab-4cd4-85ec-eeeed6830006 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:30.419896 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-bb905777-01ab-4cd4-85ec-eeeed6830006 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:04:30.427183 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bb905777-01ab-4cd4-85ec-eeeed6830006 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:30.427745 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bb905777-01ab-4cd4-85ec-eeeed6830006 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:30.428288 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bb905777-01ab-4cd4-85ec-eeeed6830006 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:30.429063 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bb905777-01ab-4cd4-85ec-eeeed6830006 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:30.429524 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bb905777-01ab-4cd4-85ec-eeeed6830006 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:30.429950 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bb905777-01ab-4cd4-85ec-eeeed6830006 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:30.572314 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-bb905777-01ab-4cd4-85ec-eeeed6830006 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:04:30.580392 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-bb905777-01ab-4cd4-85ec-eeeed6830006 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b" status: 200 len: 1367 microversion: 2.1 time: 0.165967 Oct 30 01:04:30.580959 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 537/1057] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:04:30 2022] GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:04:31.604702 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-8db1a45d-f421-420d-8a6d-d61a088467e2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:31.605308 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-8db1a45d-f421-420d-8a6d-d61a088467e2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:04:31.611684 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8db1a45d-f421-420d-8a6d-d61a088467e2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:31.612190 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8db1a45d-f421-420d-8a6d-d61a088467e2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:31.612614 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8db1a45d-f421-420d-8a6d-d61a088467e2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:31.613302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8db1a45d-f421-420d-8a6d-d61a088467e2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:31.613753 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8db1a45d-f421-420d-8a6d-d61a088467e2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:31.614184 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8db1a45d-f421-420d-8a6d-d61a088467e2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:31.741168 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8db1a45d-f421-420d-8a6d-d61a088467e2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:04:31.748755 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-8db1a45d-f421-420d-8a6d-d61a088467e2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b" status: 200 len: 1367 microversion: 2.1 time: 0.148861 Oct 30 01:04:31.749316 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 521/1058] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:04:31 2022] GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:04:32.773476 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-bd9b467b-3caa-46ef-a486-e429e8d5357a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:32.774114 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-bd9b467b-3caa-46ef-a486-e429e8d5357a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:04:32.776564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=2 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:32.777219 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=6 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:32.783285 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bd9b467b-3caa-46ef-a486-e429e8d5357a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:32.783766 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bd9b467b-3caa-46ef-a486-e429e8d5357a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:32.784246 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bd9b467b-3caa-46ef-a486-e429e8d5357a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:32.784945 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bd9b467b-3caa-46ef-a486-e429e8d5357a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:32.785434 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bd9b467b-3caa-46ef-a486-e429e8d5357a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:32.785855 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bd9b467b-3caa-46ef-a486-e429e8d5357a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:32.983642 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-bd9b467b-3caa-46ef-a486-e429e8d5357a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:04:32.992157 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-bd9b467b-3caa-46ef-a486-e429e8d5357a tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b" status: 200 len: 1557 microversion: 2.1 time: 0.222572 Oct 30 01:04:32.992723 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 538/1059] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:04:32 2022] GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b => generated 1557 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:04:33.015376 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-8d64b2b5-a82e-4b6a-9210-a7d16e7d7340 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:04:33.016028 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-8d64b2b5-a82e-4b6a-9210-a7d16e7d7340 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:04:33.017840 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=6 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:04:33.023627 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8d64b2b5-a82e-4b6a-9210-a7d16e7d7340 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:33.024125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8d64b2b5-a82e-4b6a-9210-a7d16e7d7340 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:33.024564 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8d64b2b5-a82e-4b6a-9210-a7d16e7d7340 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:33.025267 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8d64b2b5-a82e-4b6a-9210-a7d16e7d7340 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:33.025719 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8d64b2b5-a82e-4b6a-9210-a7d16e7d7340 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:33.026175 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8d64b2b5-a82e-4b6a-9210-a7d16e7d7340 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:33.155980 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-8d64b2b5-a82e-4b6a-9210-a7d16e7d7340 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144416 Oct 30 01:04:33.157198 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 522/1060] 10.222.0.36 () {58 vars in 1275 bytes} [Sun Oct 30 01:04:33 2022] GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:04:34.318865 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-e0dbcba9-2c8e-4369-ae99-f51f99ea15f8 req-0f4b4a17-0582-4597-8158-dac54873972b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "975c9084-63da-4d0a-8d00-c5826621627b", "tag": "ada45337-1d35-4c58-8683-4af5501e111e"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:04:34.329047 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-e0dbcba9-2c8e-4369-ae99-f51f99ea15f8 req-0f4b4a17-0582-4597-8158-dac54873972b service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:04:34.329519 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-e0dbcba9-2c8e-4369-ae99-f51f99ea15f8 req-0f4b4a17-0582-4597-8158-dac54873972b service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:04:34.329948 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-e0dbcba9-2c8e-4369-ae99-f51f99ea15f8 req-0f4b4a17-0582-4597-8158-dac54873972b service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:04:34.341455 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-e0dbcba9-2c8e-4369-ae99-f51f99ea15f8 req-0f4b4a17-0582-4597-8158-dac54873972b service nova] Creating event network-changed:ada45337-1d35-4c58-8683-4af5501e111e for instance 975c9084-63da-4d0a-8d00-c5826621627b on hv-cinder-86149 Oct 30 01:04:34.347019 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-e0dbcba9-2c8e-4369-ae99-f51f99ea15f8 req-0f4b4a17-0582-4597-8158-dac54873972b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031756 Oct 30 01:04:34.347609 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 539/1061] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:05:08.680733 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:08.681959 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:08.686041 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-3b6cd03e-0aaa-49e5-a54b-5db7c1543714 req-56412a0c-c5f5-487e-a956-f0d401f251e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f441dbc7-8369-4779-a326-78cbd6e9bc9d", "tag": "f3e3ac4b-534c-4019-98ab-6faab24ef915"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:05:08.686899 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e9a22fad-a5e1-4c38-8550-7a3f458237a1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:08.687459 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-e9a22fad-a5e1-4c38-8550-7a3f458237a1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:05:08.692139 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:08.692776 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:08.696455 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e9a22fad-a5e1-4c38-8550-7a3f458237a1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:08.697190 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e9a22fad-a5e1-4c38-8550-7a3f458237a1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:08.697717 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e9a22fad-a5e1-4c38-8550-7a3f458237a1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:08.698481 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e9a22fad-a5e1-4c38-8550-7a3f458237a1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:08.698597 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-3b6cd03e-0aaa-49e5-a54b-5db7c1543714 req-56412a0c-c5f5-487e-a956-f0d401f251e5 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:08.698946 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-3b6cd03e-0aaa-49e5-a54b-5db7c1543714 req-56412a0c-c5f5-487e-a956-f0d401f251e5 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:08.699052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e9a22fad-a5e1-4c38-8550-7a3f458237a1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:08.699366 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-3b6cd03e-0aaa-49e5-a54b-5db7c1543714 req-56412a0c-c5f5-487e-a956-f0d401f251e5 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:08.699477 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e9a22fad-a5e1-4c38-8550-7a3f458237a1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:08.712867 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-3b6cd03e-0aaa-49e5-a54b-5db7c1543714 req-56412a0c-c5f5-487e-a956-f0d401f251e5 service nova] Creating event network-changed:f3e3ac4b-534c-4019-98ab-6faab24ef915 for instance f441dbc7-8369-4779-a326-78cbd6e9bc9d on hv-cinder-86149 Oct 30 01:05:08.718435 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-3b6cd03e-0aaa-49e5-a54b-5db7c1543714 req-56412a0c-c5f5-487e-a956-f0d401f251e5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037161 Oct 30 01:05:08.720766 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 540/1062] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:05:08.731149 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-e9a22fad-a5e1-4c38-8550-7a3f458237a1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Going to try to terminate instance {{(pid=125553) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:05:08.823803 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e9a22fad-a5e1-4c38-8550-7a3f458237a1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 204 len: 0 microversion: 2.1 time: 0.144633 Oct 30 01:05:08.824425 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 523/1063] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 01:05:08 2022] DELETE /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:05:08.835055 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-796a601c-5465-4f8c-97fd-e7d6e06315c1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:08.835741 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-796a601c-5465-4f8c-97fd-e7d6e06315c1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:05:08.843699 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-796a601c-5465-4f8c-97fd-e7d6e06315c1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:08.844788 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-796a601c-5465-4f8c-97fd-e7d6e06315c1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:08.845782 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-796a601c-5465-4f8c-97fd-e7d6e06315c1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:08.846482 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-796a601c-5465-4f8c-97fd-e7d6e06315c1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:08.846932 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-796a601c-5465-4f8c-97fd-e7d6e06315c1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:08.847350 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-796a601c-5465-4f8c-97fd-e7d6e06315c1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:08.987391 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-796a601c-5465-4f8c-97fd-e7d6e06315c1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:05:08.995097 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-796a601c-5465-4f8c-97fd-e7d6e06315c1 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1564 microversion: 2.1 time: 0.165336 Oct 30 01:05:08.995663 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 541/1064] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:05:08 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:05:10.019533 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1612d0da-6203-42a9-9059-4c0288dd36ab tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:10.020266 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1612d0da-6203-42a9-9059-4c0288dd36ab tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:05:10.026957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1612d0da-6203-42a9-9059-4c0288dd36ab tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:10.027447 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1612d0da-6203-42a9-9059-4c0288dd36ab tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:10.027878 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1612d0da-6203-42a9-9059-4c0288dd36ab tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:10.028600 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1612d0da-6203-42a9-9059-4c0288dd36ab tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:10.029052 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1612d0da-6203-42a9-9059-4c0288dd36ab tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:10.029473 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1612d0da-6203-42a9-9059-4c0288dd36ab tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:10.196335 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1612d0da-6203-42a9-9059-4c0288dd36ab tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:05:10.204881 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1612d0da-6203-42a9-9059-4c0288dd36ab tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1564 microversion: 2.1 time: 0.189836 Oct 30 01:05:10.205440 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 524/1065] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:05:10 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1564 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:05:11.090841 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-3e062b9e-e4f6-43a4-a56b-c1db3cedc31c req-afc167ab-bf42-42d3-bb18-cf728701e144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f441dbc7-8369-4779-a326-78cbd6e9bc9d", "name": "network-vif-deleted", "tag": "f3e3ac4b-534c-4019-98ab-6faab24ef915"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:05:11.103639 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-3e062b9e-e4f6-43a4-a56b-c1db3cedc31c req-afc167ab-bf42-42d3-bb18-cf728701e144 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:11.104237 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-3e062b9e-e4f6-43a4-a56b-c1db3cedc31c req-afc167ab-bf42-42d3-bb18-cf728701e144 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:11.104662 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-3e062b9e-e4f6-43a4-a56b-c1db3cedc31c req-afc167ab-bf42-42d3-bb18-cf728701e144 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:11.117839 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-3e062b9e-e4f6-43a4-a56b-c1db3cedc31c req-afc167ab-bf42-42d3-bb18-cf728701e144 service nova] Creating event network-vif-deleted:f3e3ac4b-534c-4019-98ab-6faab24ef915 for instance f441dbc7-8369-4779-a326-78cbd6e9bc9d on hv-cinder-86149 Oct 30 01:05:11.123663 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-3e062b9e-e4f6-43a4-a56b-c1db3cedc31c req-afc167ab-bf42-42d3-bb18-cf728701e144 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036455 Oct 30 01:05:11.124271 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 542/1066] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:05:11.228351 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-34cd51fb-01c5-4bc7-af92-cdf95e036eda tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:11.229022 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-34cd51fb-01c5-4bc7-af92-cdf95e036eda tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:05:11.235484 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34cd51fb-01c5-4bc7-af92-cdf95e036eda tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:11.235963 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34cd51fb-01c5-4bc7-af92-cdf95e036eda tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:11.236420 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34cd51fb-01c5-4bc7-af92-cdf95e036eda tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:11.237107 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34cd51fb-01c5-4bc7-af92-cdf95e036eda tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:11.237554 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34cd51fb-01c5-4bc7-af92-cdf95e036eda tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:11.238030 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-34cd51fb-01c5-4bc7-af92-cdf95e036eda tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:11.299741 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-34cd51fb-01c5-4bc7-af92-cdf95e036eda tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a999d19a634bcfb26d2d936b3429bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fede7ffbdd1d4ed8bbc37b55e03e4791', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:05:11.307471 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-34cd51fb-01c5-4bc7-af92-cdf95e036eda tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 200 len: 1218 microversion: 2.1 time: 0.083004 Oct 30 01:05:11.308019 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 525/1067] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:05:11 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:05:12.331327 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-feb0c9ad-6547-4881-bf59-5f05734cba50 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:12.331975 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-feb0c9ad-6547-4881-bf59-5f05734cba50 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] [instance: f441dbc7-8369-4779-a326-78cbd6e9bc9d] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:05:12.338292 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-feb0c9ad-6547-4881-bf59-5f05734cba50 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:12.338765 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-feb0c9ad-6547-4881-bf59-5f05734cba50 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:12.339197 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-feb0c9ad-6547-4881-bf59-5f05734cba50 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:12.339880 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-feb0c9ad-6547-4881-bf59-5f05734cba50 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:12.340382 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-feb0c9ad-6547-4881-bf59-5f05734cba50 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:12.340803 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-feb0c9ad-6547-4881-bf59-5f05734cba50 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:12.354387 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-feb0c9ad-6547-4881-bf59-5f05734cba50 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] HTTP exception thrown: Instance f441dbc7-8369-4779-a326-78cbd6e9bc9d could not be found. Oct 30 01:05:12.355989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-feb0c9ad-6547-4881-bf59-5f05734cba50 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Request method failure captured: Oct 30 01:05:12.355989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d HTTP/1.1 Oct 30 01:05:12.355989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 01:05:12.355989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 01:05:12.355989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 01:05:12.355989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 01:05:12.355989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 01:05:12.355989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 01:05:12.355989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 01:05:12.355989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 01:05:12.355989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcydZDc1ZZJbPTswJdNgND0oMWLjppYV59c_KYHwtJL-j5CES_JH2T_rf5_gy4hC6xCeYwQNaJYSaUHUA_flO6a93GVNYaNVFtV7ghyP0HjgYms7o3cX96D4VlqxCFf3l5s2CsPfSxG7498VT9wvWgJ6Kb95NF1suEuuOEOE2dkVR1o Oct 30 01:05:12.355989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 01:05:12.355989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 01:05:12.355989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 01:05:12.355989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 01:05:12.355989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 01:05:12.355989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 01:05:12.355989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: fede7ffbdd1d4ed8bbc37b55e03e4791 Oct 30 01:05:12.355989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-TestShelveInstance-1660099956 Oct 30 01:05:12.355989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 01:05:12.355989 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 01:05:12.357517 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fede7ffbdd1d4ed8bbc37b55e03e4791"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fede7ffbdd1d4ed8bbc37b55e03e4791"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fede7ffbdd1d4ed8bbc37b55e03e4791"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fede7ffbdd1d4ed8bbc37b55e03e4791"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:05:12.357517 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-TestShelveInstance-1660099956 Oct 30 01:05:12.357517 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: fede7ffbdd1d4ed8bbc37b55e03e4791 Oct 30 01:05:12.357517 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-TestShelveInstance-1660099956 Oct 30 01:05:12.357517 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-TestShelveInstance-1660099956-project Oct 30 01:05:12.357517 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 01:05:12.357517 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 01:05:12.357517 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: b8a999d19a634bcfb26d2d936b3429bc Oct 30 01:05:12.357517 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-TestShelveInstance-1660099956-project Oct 30 01:05:12.357517 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 01:05:12.357517 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Instance f441dbc7-8369-4779-a326-78cbd6e9bc9d could not be found. Oct 30 01:05:12.357517 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': 'f441dbc7-8369-4779-a326-78cbd6e9bc9d'} Oct 30 01:05:12.358378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:05:12.358378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:05:12.358378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:05:12.358378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:05:12.358378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:05:12.358378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:05:12.358378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:05:12.358378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:05:12.358378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:05:12.358378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:05:12.358378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f441dbc7-8369-4779-a326-78cbd6e9bc9d could not be found. Oct 30 01:05:12.358378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:05:12.358378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:05:12.358378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:05:12.358378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:05:12.358378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:05:12.358378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:05:12.358378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:05:12.358378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:05:12.358378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:05:12.359761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:05:12.359761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:05:12.359761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:05:12.359761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:05:12.359761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:05:12.359761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:05:12.359761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:05:12.359761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f441dbc7-8369-4779-a326-78cbd6e9bc9d could not be found. Oct 30 01:05:12.359761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:05:12.359761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:05:12.359761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:05:12.359761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:05:12.359761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:05:12.359761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:05:12.359761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:05:12.359761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:05:12.359761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f441dbc7-8369-4779-a326-78cbd6e9bc9d could not be found. Oct 30 01:05:12.359761 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:05:12.361733 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-feb0c9ad-6547-4881-bf59-5f05734cba50 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Returning 404 to user: Instance f441dbc7-8369-4779-a326-78cbd6e9bc9d could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:05:12.361733 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-feb0c9ad-6547-4881-bf59-5f05734cba50 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d" status: 404 len: 111 microversion: 2.1 time: 0.030889 Oct 30 01:05:12.361733 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 543/1068] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:05:12 2022] GET /compute/v2.1/servers/f441dbc7-8369-4779-a326-78cbd6e9bc9d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:05:12.518282 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-93aa4af9-ff01-432f-83ed-eae63cae3ee5 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] Calling method '.version_select at 0x7faf75bb5ee0>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:12.541969 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-93aa4af9-ff01-432f-83ed-eae63cae3ee5 tempest-TestShelveInstance-1660099956 tempest-TestShelveInstance-1660099956-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-486884272" status: 202 len: 0 microversion: 2.1 time: 0.027703 Oct 30 01:05:12.543206 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 526/1069] 10.222.0.36 () {58 vars in 1251 bytes} [Sun Oct 30 01:05:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-486884272 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:05:30.012103 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=8 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:30.013731 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=12 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:30.212225 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-0a0a848a-d762-4431-859a-b2fc315c1f33 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Action: 'create', calling method: .version_select at 0x7faf792dc310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1905451183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqmtAfCj+TfQ4lltlofp4c9j/qPIKcchkWkPiOtFwU1KamCETFBKOCybRGQ+Kzn013vxN+avzdWPR01aFI+wPy0WU/fWG/jjtRWpF+FCgzdVVR3wTBWO3VCHG3W3IFyoQ=="}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:05:30.228510 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-0a0a848a-d762-4431-859a-b2fc315c1f33 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Getting quotas for project a8a24adf04bb4adfbc7347a5e4ec6b52. Resources: {'key_pairs'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:05:30.232602 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-0a0a848a-d762-4431-859a-b2fc315c1f33 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Getting quotas for user d6d3fe4f3fbb4dedb7a0703a2bb6884d and project a8a24adf04bb4adfbc7347a5e4ec6b52. Resources: {'key_pairs'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:05:30.256891 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-0a0a848a-d762-4431-859a-b2fc315c1f33 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.254269 Oct 30 01:05:30.257585 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 544/1070] 10.222.0.36 () {60 vars in 1159 bytes} [Sun Oct 30 01:05:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:05:49.383620 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-9ea914c0-d474-438b-92a5-19428af3a3ef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:49.384137 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-9ea914c0-d474-438b-92a5-19428af3a3ef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:05:49.386392 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:49.387029 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:49.393940 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9ea914c0-d474-438b-92a5-19428af3a3ef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:49.394476 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9ea914c0-d474-438b-92a5-19428af3a3ef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:49.394903 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9ea914c0-d474-438b-92a5-19428af3a3ef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:49.395590 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9ea914c0-d474-438b-92a5-19428af3a3ef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:49.396040 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9ea914c0-d474-438b-92a5-19428af3a3ef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:49.396481 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9ea914c0-d474-438b-92a5-19428af3a3ef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:49.423280 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-9ea914c0-d474-438b-92a5-19428af3a3ef tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b/ips" status: 200 len: 149 microversion: 2.1 time: 0.045271 Oct 30 01:05:49.423841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 527/1071] 10.222.0.36 () {58 vars in 1248 bytes} [Sun Oct 30 01:05:49 2022] GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:05:51.808213 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=4 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:51.808961 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:05:51.813443 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c52bf199-454f-4cc6-94e0-6e642f8cf325 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae4a9e36-01f2-47db-b4b2-476152d8fef7"}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:05:51.816612 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c52bf199-454f-4cc6-94e0-6e642f8cf325 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:05:51.824048 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c52bf199-454f-4cc6-94e0-6e642f8cf325 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:51.824554 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c52bf199-454f-4cc6-94e0-6e642f8cf325 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:51.825250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c52bf199-454f-4cc6-94e0-6e642f8cf325 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:51.825946 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c52bf199-454f-4cc6-94e0-6e642f8cf325 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:51.826399 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c52bf199-454f-4cc6-94e0-6e642f8cf325 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:51.826826 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c52bf199-454f-4cc6-94e0-6e642f8cf325 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:52.090743 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c52bf199-454f-4cc6-94e0-6e642f8cf325 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "POST /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283569 Oct 30 01:05:52.091408 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 545/1072] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Oct 30 01:05:51 2022] POST /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:05:53.953498 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-9fa7f700-a164-41d3-84f4-f91c4341b596 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1269546486", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1905451183", "security_groups": [{"name": "tempest-secgroup-smoke-1393638939"}], "block_device_mapping_v2": [{"uuid": "aad15af0-f3a0-4766-8df3-4e6ee0a6bcff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e079eebe-8fcb-409d-9370-b9e72d108471"}]}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:05:54.067143 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.network.neutron [None req-9fa7f700-a164-41d3-84f4-f91c4341b596 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] validate_networks() for [('e079eebe-8fcb-409d-9370-b9e72d108471', None, None, None, None, None)] {{(pid=125553) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:05:54.464535 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 01:05:54.464758 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Sun Oct 30 01:05:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.36) !!! Oct 30 01:05:54.530395 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-9fa7f700-a164-41d3-84f4-f91c4341b596 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Flavor limits 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:05:54.530820 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-9fa7f700-a164-41d3-84f4-f91c4341b596 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Image limits 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:05:54.531287 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-9fa7f700-a164-41d3-84f4-f91c4341b596 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Flavor pref 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:05:54.531838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-9fa7f700-a164-41d3-84f4-f91c4341b596 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Image pref 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:05:54.532757 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-9fa7f700-a164-41d3-84f4-f91c4341b596 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:05:54.541858 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9fa7f700-a164-41d3-84f4-f91c4341b596 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:54.542477 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9fa7f700-a164-41d3-84f4-f91c4341b596 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:54.543002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9fa7f700-a164-41d3-84f4-f91c4341b596 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:54.544041 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9fa7f700-a164-41d3-84f4-f91c4341b596 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:54.544652 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9fa7f700-a164-41d3-84f4-f91c4341b596 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:54.545075 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9fa7f700-a164-41d3-84f4-f91c4341b596 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:54.561246 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-9fa7f700-a164-41d3-84f4-f91c4341b596 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Getting quotas for project a8a24adf04bb4adfbc7347a5e4ec6b52. Resources: {'instances', 'cores', 'ram'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:05:54.566126 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-9fa7f700-a164-41d3-84f4-f91c4341b596 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Getting quotas for user d6d3fe4f3fbb4dedb7a0703a2bb6884d and project a8a24adf04bb4adfbc7347a5e4ec6b52. Resources: {'instances', 'cores', 'ram'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:05:54.621662 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-9fa7f700-a164-41d3-84f4-f91c4341b596 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Going to run 1 instances... {{(pid=125553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:05:54.623826 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-9fa7f700-a164-41d3-84f4-f91c4341b596 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aad15af0-f3a0-4766-8df3-4e6ee0a6bcff',volume_size=None,volume_type=None)] {{(pid=125553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:05:54.754009 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-9fa7f700-a164-41d3-84f4-f91c4341b596 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.804979 Oct 30 01:05:54.754648 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 528/1073] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Oct 30 01:05:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:05:54.772336 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-24a47267-d5b5-48ec-a151-0fd132d6011f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:54.773033 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-24a47267-d5b5-48ec-a151-0fd132d6011f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:05:54.831753 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-24a47267-d5b5-48ec-a151-0fd132d6011f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:05:54.838671 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-24a47267-d5b5-48ec-a151-0fd132d6011f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 200 len: 1095 microversion: 2.1 time: 0.075312 Oct 30 01:05:54.839257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 546/1074] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:05:54 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:05:55.862990 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f286132e-1d6d-452d-b6f6-3d4b9f84faf3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:55.863663 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f286132e-1d6d-452d-b6f6-3d4b9f84faf3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:05:55.870081 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f286132e-1d6d-452d-b6f6-3d4b9f84faf3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:55.870572 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f286132e-1d6d-452d-b6f6-3d4b9f84faf3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:55.871010 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f286132e-1d6d-452d-b6f6-3d4b9f84faf3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:55.871711 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f286132e-1d6d-452d-b6f6-3d4b9f84faf3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:55.872184 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f286132e-1d6d-452d-b6f6-3d4b9f84faf3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:55.872746 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f286132e-1d6d-452d-b6f6-3d4b9f84faf3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:55.946878 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f286132e-1d6d-452d-b6f6-3d4b9f84faf3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:05:55.955121 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f286132e-1d6d-452d-b6f6-3d4b9f84faf3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 200 len: 1201 microversion: 2.1 time: 0.096965 Oct 30 01:05:55.955974 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 529/1075] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:05:55 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 1201 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:05:56.981081 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-fd20f303-400c-4f39-a1ed-d8d730e9d387 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:56.981682 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-fd20f303-400c-4f39-a1ed-d8d730e9d387 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:05:56.989547 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fd20f303-400c-4f39-a1ed-d8d730e9d387 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:56.990029 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fd20f303-400c-4f39-a1ed-d8d730e9d387 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:56.990460 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fd20f303-400c-4f39-a1ed-d8d730e9d387 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:56.991151 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fd20f303-400c-4f39-a1ed-d8d730e9d387 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:56.991595 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fd20f303-400c-4f39-a1ed-d8d730e9d387 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:56.992011 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fd20f303-400c-4f39-a1ed-d8d730e9d387 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:57.128709 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-fd20f303-400c-4f39-a1ed-d8d730e9d387 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:05:57.136492 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-fd20f303-400c-4f39-a1ed-d8d730e9d387 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 200 len: 1279 microversion: 2.1 time: 0.159236 Oct 30 01:05:57.137368 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 547/1076] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:05:56 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 1279 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:05:57.310799 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-191eb234-f59e-4c70-bc75-6300b4b6859f req-6ae13bbb-f162-4bed-9c61-7bdb919d9709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb312adb-3d03-43c7-aadf-adc7cc771e65", "tag": "d30b3add-32a3-4ae5-8567-e6dd0db6daa5"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:05:57.321897 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-191eb234-f59e-4c70-bc75-6300b4b6859f req-6ae13bbb-f162-4bed-9c61-7bdb919d9709 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:57.322435 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-191eb234-f59e-4c70-bc75-6300b4b6859f req-6ae13bbb-f162-4bed-9c61-7bdb919d9709 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:57.322946 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-191eb234-f59e-4c70-bc75-6300b4b6859f req-6ae13bbb-f162-4bed-9c61-7bdb919d9709 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:57.337519 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-191eb234-f59e-4c70-bc75-6300b4b6859f req-6ae13bbb-f162-4bed-9c61-7bdb919d9709 service nova] Creating event network-changed:d30b3add-32a3-4ae5-8567-e6dd0db6daa5 for instance eb312adb-3d03-43c7-aadf-adc7cc771e65 on hv-cinder-86149 Oct 30 01:05:57.342472 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-191eb234-f59e-4c70-bc75-6300b4b6859f req-6ae13bbb-f162-4bed-9c61-7bdb919d9709 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102023 Oct 30 01:05:57.343320 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 530/1077] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:05:58.159870 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d05d6bfc-4588-4db7-aa47-1a999013fc18 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:58.160511 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-d05d6bfc-4588-4db7-aa47-1a999013fc18 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:05:58.166861 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d05d6bfc-4588-4db7-aa47-1a999013fc18 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:58.167336 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d05d6bfc-4588-4db7-aa47-1a999013fc18 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:58.167769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d05d6bfc-4588-4db7-aa47-1a999013fc18 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:58.168487 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d05d6bfc-4588-4db7-aa47-1a999013fc18 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:58.168945 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d05d6bfc-4588-4db7-aa47-1a999013fc18 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:58.169365 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d05d6bfc-4588-4db7-aa47-1a999013fc18 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:58.301932 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-d05d6bfc-4588-4db7-aa47-1a999013fc18 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:05:58.309404 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-d05d6bfc-4588-4db7-aa47-1a999013fc18 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 200 len: 1279 microversion: 2.1 time: 0.154359 Oct 30 01:05:58.309961 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 548/1078] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:05:58 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 1279 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:05:59.333418 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e7fd651c-58aa-4a6a-9b6b-8f4f2441e90b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:59.334002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-e7fd651c-58aa-4a6a-9b6b-8f4f2441e90b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:05:59.340497 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e7fd651c-58aa-4a6a-9b6b-8f4f2441e90b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:59.340975 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e7fd651c-58aa-4a6a-9b6b-8f4f2441e90b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:59.341410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e7fd651c-58aa-4a6a-9b6b-8f4f2441e90b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:59.342106 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e7fd651c-58aa-4a6a-9b6b-8f4f2441e90b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:59.342565 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e7fd651c-58aa-4a6a-9b6b-8f4f2441e90b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:59.342985 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e7fd651c-58aa-4a6a-9b6b-8f4f2441e90b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:59.481235 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-e7fd651c-58aa-4a6a-9b6b-8f4f2441e90b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:05:59.489284 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e7fd651c-58aa-4a6a-9b6b-8f4f2441e90b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 200 len: 1279 microversion: 2.1 time: 0.160084 Oct 30 01:05:59.489838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 531/1079] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:05:59 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 1279 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:05:59.742882 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-027b16c6-9ae3-4211-873b-607345649b7e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:59.743374 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-027b16c6-9ae3-4211-873b-607345649b7e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:05:59.749711 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-027b16c6-9ae3-4211-873b-607345649b7e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:59.750190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-027b16c6-9ae3-4211-873b-607345649b7e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:59.751488 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-027b16c6-9ae3-4211-873b-607345649b7e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:59.752209 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-027b16c6-9ae3-4211-873b-607345649b7e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:59.752663 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-027b16c6-9ae3-4211-873b-607345649b7e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:59.753085 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-027b16c6-9ae3-4211-873b-607345649b7e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:59.836332 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.objects.instance [None req-027b16c6-9ae3-4211-873b-607345649b7e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lazy-loading 'services' on Instance uuid 975c9084-63da-4d0a-8d00-c5826621627b {{(pid=125554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:05:59.908854 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-027b16c6-9ae3-4211-873b-607345649b7e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "DELETE /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b/os-volume_attachments/ae4a9e36-01f2-47db-b4b2-476152d8fef7" status: 202 len: 0 microversion: 2.1 time: 0.169656 Oct 30 01:05:59.909438 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 549/1080] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Oct 30 01:05:59 2022] DELETE /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b/os-volume_attachments/ae4a9e36-01f2-47db-b4b2-476152d8fef7 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:05:59.917733 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5052c0a2-e51b-49e1-a5a8-44f54d01db02 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:05:59.920045 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5052c0a2-e51b-49e1-a5a8-44f54d01db02 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:05:59.929041 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5052c0a2-e51b-49e1-a5a8-44f54d01db02 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:59.929536 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5052c0a2-e51b-49e1-a5a8-44f54d01db02 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:59.930009 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5052c0a2-e51b-49e1-a5a8-44f54d01db02 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:59.930719 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5052c0a2-e51b-49e1-a5a8-44f54d01db02 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:05:59.931176 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5052c0a2-e51b-49e1-a5a8-44f54d01db02 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:05:59.931602 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5052c0a2-e51b-49e1-a5a8-44f54d01db02 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:05:59.962327 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5052c0a2-e51b-49e1-a5a8-44f54d01db02 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048580 Oct 30 01:05:59.962873 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 532/1081] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Oct 30 01:05:59 2022] GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:06:00.513331 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7af0e53f-f338-4a75-8b43-551355a9a6e1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:00.514026 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-7af0e53f-f338-4a75-8b43-551355a9a6e1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:00.520324 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7af0e53f-f338-4a75-8b43-551355a9a6e1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:00.520797 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7af0e53f-f338-4a75-8b43-551355a9a6e1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:00.521233 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7af0e53f-f338-4a75-8b43-551355a9a6e1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:00.521920 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7af0e53f-f338-4a75-8b43-551355a9a6e1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:00.522379 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7af0e53f-f338-4a75-8b43-551355a9a6e1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:00.522803 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7af0e53f-f338-4a75-8b43-551355a9a6e1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:00.660995 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7af0e53f-f338-4a75-8b43-551355a9a6e1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:06:00.668721 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7af0e53f-f338-4a75-8b43-551355a9a6e1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 200 len: 1267 microversion: 2.1 time: 0.159609 Oct 30 01:06:00.669280 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 550/1082] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:06:00 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:06:00.975848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a9363c4e-0096-4f03-8537-c7e5d7d26118 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:00.978043 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a9363c4e-0096-4f03-8537-c7e5d7d26118 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:00.984619 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9363c4e-0096-4f03-8537-c7e5d7d26118 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:00.985315 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9363c4e-0096-4f03-8537-c7e5d7d26118 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:00.985774 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9363c4e-0096-4f03-8537-c7e5d7d26118 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:00.986577 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9363c4e-0096-4f03-8537-c7e5d7d26118 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:00.987032 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9363c4e-0096-4f03-8537-c7e5d7d26118 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:00.987472 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9363c4e-0096-4f03-8537-c7e5d7d26118 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:01.016627 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a9363c4e-0096-4f03-8537-c7e5d7d26118 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044208 Oct 30 01:06:01.017163 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 533/1083] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Oct 30 01:06:00 2022] GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:06:01.692580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-65154a45-d200-4d5e-b894-eb4762b10a4d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:01.693236 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-65154a45-d200-4d5e-b894-eb4762b10a4d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:01.699843 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-65154a45-d200-4d5e-b894-eb4762b10a4d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:01.700354 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-65154a45-d200-4d5e-b894-eb4762b10a4d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:01.700793 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-65154a45-d200-4d5e-b894-eb4762b10a4d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:01.701483 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-65154a45-d200-4d5e-b894-eb4762b10a4d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:01.701935 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-65154a45-d200-4d5e-b894-eb4762b10a4d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:01.702356 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-65154a45-d200-4d5e-b894-eb4762b10a4d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:01.832617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-65154a45-d200-4d5e-b894-eb4762b10a4d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:06:01.840243 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-65154a45-d200-4d5e-b894-eb4762b10a4d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 200 len: 1267 microversion: 2.1 time: 0.151720 Oct 30 01:06:01.840810 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 551/1084] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:06:01 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:06:02.029154 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-035df201-c374-4437-9bf1-6d3146b7e83c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:02.031252 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-035df201-c374-4437-9bf1-6d3146b7e83c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:02.037666 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-035df201-c374-4437-9bf1-6d3146b7e83c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:02.038148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-035df201-c374-4437-9bf1-6d3146b7e83c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:02.038583 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-035df201-c374-4437-9bf1-6d3146b7e83c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:02.039272 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-035df201-c374-4437-9bf1-6d3146b7e83c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:02.039727 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-035df201-c374-4437-9bf1-6d3146b7e83c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:02.040173 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-035df201-c374-4437-9bf1-6d3146b7e83c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:02.069157 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-035df201-c374-4437-9bf1-6d3146b7e83c tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044050 Oct 30 01:06:02.069703 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 534/1085] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Oct 30 01:06:02 2022] GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:06:02.135544 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-18118649-08b8-4be8-9403-0bdd5ebe87e9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:02.136033 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-18118649-08b8-4be8-9403-0bdd5ebe87e9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:02.142715 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-18118649-08b8-4be8-9403-0bdd5ebe87e9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:02.143191 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-18118649-08b8-4be8-9403-0bdd5ebe87e9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:02.143623 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-18118649-08b8-4be8-9403-0bdd5ebe87e9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:02.144337 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-18118649-08b8-4be8-9403-0bdd5ebe87e9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:02.144786 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-18118649-08b8-4be8-9403-0bdd5ebe87e9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:02.145205 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-18118649-08b8-4be8-9403-0bdd5ebe87e9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:02.169409 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-18118649-08b8-4be8-9403-0bdd5ebe87e9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Going to try to terminate instance {{(pid=125554) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:06:02.245291 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-18118649-08b8-4be8-9403-0bdd5ebe87e9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "DELETE /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b" status: 204 len: 0 microversion: 2.1 time: 0.116948 Oct 30 01:06:02.245892 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 552/1086] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 01:06:02 2022] DELETE /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:06:02.255866 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-79865b24-e0c5-480d-b8b3-91e4abd4c940 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:02.256517 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-79865b24-e0c5-480d-b8b3-91e4abd4c940 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:02.262516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-79865b24-e0c5-480d-b8b3-91e4abd4c940 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:02.263000 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-79865b24-e0c5-480d-b8b3-91e4abd4c940 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:02.263437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-79865b24-e0c5-480d-b8b3-91e4abd4c940 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:02.264165 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-79865b24-e0c5-480d-b8b3-91e4abd4c940 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:02.264619 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-79865b24-e0c5-480d-b8b3-91e4abd4c940 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:02.265046 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-79865b24-e0c5-480d-b8b3-91e4abd4c940 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:02.392941 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-79865b24-e0c5-480d-b8b3-91e4abd4c940 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:06:02.400616 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-79865b24-e0c5-480d-b8b3-91e4abd4c940 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b" status: 200 len: 1681 microversion: 2.1 time: 0.150019 Oct 30 01:06:02.401165 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 535/1087] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:06:02 2022] GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:06:02.864705 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2b71755d-971f-4f30-ad33-ac8b45a78f92 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:02.868858 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2b71755d-971f-4f30-ad33-ac8b45a78f92 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:02.874447 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2b71755d-971f-4f30-ad33-ac8b45a78f92 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:02.875037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2b71755d-971f-4f30-ad33-ac8b45a78f92 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:02.876038 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2b71755d-971f-4f30-ad33-ac8b45a78f92 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:02.876774 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2b71755d-971f-4f30-ad33-ac8b45a78f92 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:02.877247 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2b71755d-971f-4f30-ad33-ac8b45a78f92 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:02.877665 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2b71755d-971f-4f30-ad33-ac8b45a78f92 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:03.014347 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2b71755d-971f-4f30-ad33-ac8b45a78f92 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:06:03.022151 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2b71755d-971f-4f30-ad33-ac8b45a78f92 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 200 len: 1267 microversion: 2.1 time: 0.162491 Oct 30 01:06:03.022711 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 553/1088] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:06:02 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:06:03.423070 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-94288003-82c6-4a0d-ac3b-8d41805d9495 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:03.423683 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-94288003-82c6-4a0d-ac3b-8d41805d9495 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:03.430116 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-94288003-82c6-4a0d-ac3b-8d41805d9495 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:03.430602 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-94288003-82c6-4a0d-ac3b-8d41805d9495 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:03.431039 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-94288003-82c6-4a0d-ac3b-8d41805d9495 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:03.431724 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-94288003-82c6-4a0d-ac3b-8d41805d9495 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:03.432218 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-94288003-82c6-4a0d-ac3b-8d41805d9495 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:03.432643 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-94288003-82c6-4a0d-ac3b-8d41805d9495 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:03.560725 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-94288003-82c6-4a0d-ac3b-8d41805d9495 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:06:03.569132 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-94288003-82c6-4a0d-ac3b-8d41805d9495 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b" status: 200 len: 1681 microversion: 2.1 time: 0.149888 Oct 30 01:06:03.569712 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 536/1089] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:06:03 2022] GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:06:04.045764 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4e8defcc-9357-40a6-9967-1dca3806c9ad tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:04.046375 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-4e8defcc-9357-40a6-9967-1dca3806c9ad tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:04.053273 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e8defcc-9357-40a6-9967-1dca3806c9ad tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:04.053752 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e8defcc-9357-40a6-9967-1dca3806c9ad tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:04.054206 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e8defcc-9357-40a6-9967-1dca3806c9ad tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:04.054896 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e8defcc-9357-40a6-9967-1dca3806c9ad tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:04.055347 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e8defcc-9357-40a6-9967-1dca3806c9ad tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:04.055769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4e8defcc-9357-40a6-9967-1dca3806c9ad tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:04.190724 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-4e8defcc-9357-40a6-9967-1dca3806c9ad tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:06:04.198308 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-4e8defcc-9357-40a6-9967-1dca3806c9ad tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 200 len: 1267 microversion: 2.1 time: 0.156453 Oct 30 01:06:04.199166 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 554/1090] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:06:04 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:06:04.593358 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-b7301abc-f969-408c-9b1a-886fd4bf117e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:04.595254 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-b7301abc-f969-408c-9b1a-886fd4bf117e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:04.597741 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=2 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:04.598474 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=6 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:04.604220 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b7301abc-f969-408c-9b1a-886fd4bf117e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:04.604706 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b7301abc-f969-408c-9b1a-886fd4bf117e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:04.605136 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b7301abc-f969-408c-9b1a-886fd4bf117e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:04.605828 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b7301abc-f969-408c-9b1a-886fd4bf117e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:04.606280 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b7301abc-f969-408c-9b1a-886fd4bf117e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:04.606696 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b7301abc-f969-408c-9b1a-886fd4bf117e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:04.738835 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-b7301abc-f969-408c-9b1a-886fd4bf117e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:06:04.747140 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-b7301abc-f969-408c-9b1a-886fd4bf117e tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b" status: 200 len: 1681 microversion: 2.1 time: 0.157696 Oct 30 01:06:04.747790 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 537/1091] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:06:04 2022] GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:06:05.065928 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-e179426f-7a03-40fa-ab79-ef5f42a50d3a req-6e5ae275-12ae-4f12-a866-c6cbe095a33d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "975c9084-63da-4d0a-8d00-c5826621627b", "name": "network-vif-deleted", "tag": "ada45337-1d35-4c58-8683-4af5501e111e"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:06:05.071994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=2 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:05.079086 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-e179426f-7a03-40fa-ab79-ef5f42a50d3a req-6e5ae275-12ae-4f12-a866-c6cbe095a33d service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:05.079580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-e179426f-7a03-40fa-ab79-ef5f42a50d3a req-6e5ae275-12ae-4f12-a866-c6cbe095a33d service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:05.080003 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-e179426f-7a03-40fa-ab79-ef5f42a50d3a req-6e5ae275-12ae-4f12-a866-c6cbe095a33d service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:05.092376 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-e179426f-7a03-40fa-ab79-ef5f42a50d3a req-6e5ae275-12ae-4f12-a866-c6cbe095a33d service nova] Creating event network-vif-deleted:ada45337-1d35-4c58-8683-4af5501e111e for instance 975c9084-63da-4d0a-8d00-c5826621627b on hv-cinder-86149 Oct 30 01:06:05.097879 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-e179426f-7a03-40fa-ab79-ef5f42a50d3a req-6e5ae275-12ae-4f12-a866-c6cbe095a33d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036526 Oct 30 01:06:05.098576 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 555/1092] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:06:05.223329 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-ea73f869-12d5-41b4-97fa-9d616b39b418 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:05.223957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-ea73f869-12d5-41b4-97fa-9d616b39b418 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:05.231899 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea73f869-12d5-41b4-97fa-9d616b39b418 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:05.232755 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea73f869-12d5-41b4-97fa-9d616b39b418 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:05.233368 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea73f869-12d5-41b4-97fa-9d616b39b418 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:05.234569 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea73f869-12d5-41b4-97fa-9d616b39b418 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:05.235267 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea73f869-12d5-41b4-97fa-9d616b39b418 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:05.235867 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ea73f869-12d5-41b4-97fa-9d616b39b418 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:05.393929 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ea73f869-12d5-41b4-97fa-9d616b39b418 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:06:05.401784 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-ea73f869-12d5-41b4-97fa-9d616b39b418 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 200 len: 1267 microversion: 2.1 time: 0.183867 Oct 30 01:06:05.402316 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 538/1093] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:06:05 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:06:05.771561 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-85f54b2b-2a48-495f-95bb-45feff2652cf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:05.772285 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-85f54b2b-2a48-495f-95bb-45feff2652cf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:05.778379 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-85f54b2b-2a48-495f-95bb-45feff2652cf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:05.778858 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-85f54b2b-2a48-495f-95bb-45feff2652cf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:05.779294 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-85f54b2b-2a48-495f-95bb-45feff2652cf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:05.779983 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-85f54b2b-2a48-495f-95bb-45feff2652cf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:05.780464 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-85f54b2b-2a48-495f-95bb-45feff2652cf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:05.780890 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-85f54b2b-2a48-495f-95bb-45feff2652cf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:05.814027 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-85f54b2b-2a48-495f-95bb-45feff2652cf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:05.814505 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-85f54b2b-2a48-495f-95bb-45feff2652cf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:05.814938 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-85f54b2b-2a48-495f-95bb-45feff2652cf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:05.815386 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.objects.instance [None req-85f54b2b-2a48-495f-95bb-45feff2652cf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lazy-loading 'fault' on Instance uuid 975c9084-63da-4d0a-8d00-c5826621627b {{(pid=125554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:06:05.858000 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-85f54b2b-2a48-495f-95bb-45feff2652cf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7353722ccb7548a6b92c89d4917fefaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc70ef555fc84a51b3521007d00b77e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:06:05.866866 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-85f54b2b-2a48-495f-95bb-45feff2652cf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b" status: 200 len: 1331 microversion: 2.1 time: 0.099208 Oct 30 01:06:05.867101 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 556/1094] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:06:05 2022] GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:06:06.425042 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-9ba27f8c-20af-4fb7-9549-bcfa823026ef tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:06.425620 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-9ba27f8c-20af-4fb7-9549-bcfa823026ef tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:06.431372 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9ba27f8c-20af-4fb7-9549-bcfa823026ef tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:06.431851 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9ba27f8c-20af-4fb7-9549-bcfa823026ef tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:06.432331 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9ba27f8c-20af-4fb7-9549-bcfa823026ef tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:06.433040 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9ba27f8c-20af-4fb7-9549-bcfa823026ef tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:06.433496 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9ba27f8c-20af-4fb7-9549-bcfa823026ef tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:06.433923 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-9ba27f8c-20af-4fb7-9549-bcfa823026ef tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:06.566822 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-9ba27f8c-20af-4fb7-9549-bcfa823026ef tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:06:06.574767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-9ba27f8c-20af-4fb7-9549-bcfa823026ef tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 200 len: 1267 microversion: 2.1 time: 0.153871 Oct 30 01:06:06.575326 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 539/1095] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:06:06 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:06:06.890094 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-5e495966-974f-4edf-a20f-1c59f6f10a6b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:06.891209 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-5e495966-974f-4edf-a20f-1c59f6f10a6b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:06.897857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5e495966-974f-4edf-a20f-1c59f6f10a6b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:06.898335 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5e495966-974f-4edf-a20f-1c59f6f10a6b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:06.898769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5e495966-974f-4edf-a20f-1c59f6f10a6b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:06.899506 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5e495966-974f-4edf-a20f-1c59f6f10a6b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:06.899956 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5e495966-974f-4edf-a20f-1c59f6f10a6b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:06.900405 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5e495966-974f-4edf-a20f-1c59f6f10a6b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:06.914481 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-5e495966-974f-4edf-a20f-1c59f6f10a6b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] HTTP exception thrown: Instance 975c9084-63da-4d0a-8d00-c5826621627b could not be found. Oct 30 01:06:06.916133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-5e495966-974f-4edf-a20f-1c59f6f10a6b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Request method failure captured: Oct 30 01:06:06.916133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b HTTP/1.1 Oct 30 01:06:06.916133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 01:06:06.916133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 01:06:06.916133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 01:06:06.916133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 01:06:06.916133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 01:06:06.916133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 01:06:06.916133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 01:06:06.916133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 01:06:06.916133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcxY8meP6vvhjbMl5SDegLis0GNSJ-as78-NEFrPY5visYG6nAB9FJqsqSnKlmkLjDyOiz2t_9jR7dQbTJVad7Ot58e6fXvOwVA87-vsO9JQuc5io49RaVNBH3eRFW0SDeH6mC7M6KHqZYWVfoplDjyGh6d_VPsrjSppQ78VV6m9NHw Oct 30 01:06:06.916133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 01:06:06.916133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 01:06:06.916133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 01:06:06.916133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 01:06:06.916133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 01:06:06.916133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 01:06:06.916133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:06:06.916133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:06.916133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 01:06:06.916133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 01:06:06.917880 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:06:06.917880 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:06.917880 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:06:06.917880 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:06.917880 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:06:06.917880 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 01:06:06.917880 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 01:06:06.917880 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 7353722ccb7548a6b92c89d4917fefaa Oct 30 01:06:06.917880 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:06:06.917880 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 01:06:06.917880 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Instance 975c9084-63da-4d0a-8d00-c5826621627b could not be found. Oct 30 01:06:06.917880 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': '975c9084-63da-4d0a-8d00-c5826621627b'} Oct 30 01:06:06.918907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:06:06.918907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:06.918907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:06:06.918907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:06:06.918907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:06:06.918907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:06:06.918907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:06:06.918907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:06:06.918907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:06:06.918907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:06:06.918907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 975c9084-63da-4d0a-8d00-c5826621627b could not be found. Oct 30 01:06:06.918907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:06.918907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:06.918907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:06.918907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:06.918907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:06.918907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:06.918907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:06:06.918907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:06:06.918907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:06:06.920401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:06:06.920401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:06:06.920401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:06:06.920401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:06:06.920401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:06:06.920401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:06:06.920401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:06:06.920401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 975c9084-63da-4d0a-8d00-c5826621627b could not be found. Oct 30 01:06:06.920401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:06.920401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:06.920401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:06.920401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:06.920401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:06.920401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:06.920401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:06:06.920401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:06:06.920401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 975c9084-63da-4d0a-8d00-c5826621627b could not be found. Oct 30 01:06:06.920401 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:06.922024 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-5e495966-974f-4edf-a20f-1c59f6f10a6b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Returning 404 to user: Instance 975c9084-63da-4d0a-8d00-c5826621627b could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:06:06.922024 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-5e495966-974f-4edf-a20f-1c59f6f10a6b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b" status: 404 len: 111 microversion: 2.1 time: 0.031376 Oct 30 01:06:06.922024 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 557/1096] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:06:06 2022] GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:06:06.926449 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d383d91d-2f2f-48a8-8ebc-448962e29d86 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '.version_select at 0x7faf75c04280>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:06.945450 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d383d91d-2f2f-48a8-8ebc-448962e29d86 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-522933993" status: 202 len: 0 microversion: 2.1 time: 0.022883 Oct 30 01:06:06.945997 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 540/1097] 10.222.0.36 () {58 vars in 1218 bytes} [Sun Oct 30 01:06:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-522933993 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:06:07.598668 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-ca208139-7b52-485c-8d1a-dc2bafa1e399 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:07.599302 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-ca208139-7b52-485c-8d1a-dc2bafa1e399 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:07.605573 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca208139-7b52-485c-8d1a-dc2bafa1e399 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:07.606257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca208139-7b52-485c-8d1a-dc2bafa1e399 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:07.606920 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca208139-7b52-485c-8d1a-dc2bafa1e399 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:07.607798 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca208139-7b52-485c-8d1a-dc2bafa1e399 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:07.608283 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca208139-7b52-485c-8d1a-dc2bafa1e399 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:07.609532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-ca208139-7b52-485c-8d1a-dc2bafa1e399 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:07.747712 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-ca208139-7b52-485c-8d1a-dc2bafa1e399 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:06:07.755571 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-ca208139-7b52-485c-8d1a-dc2bafa1e399 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 200 len: 1267 microversion: 2.1 time: 0.160870 Oct 30 01:06:07.756147 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 558/1098] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:06:07 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:06:08.690366 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-66e2cb45-ed43-40bf-bdfb-c4c44fbb8ca4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:08.690907 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-66e2cb45-ed43-40bf-bdfb-c4c44fbb8ca4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:08.697206 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-66e2cb45-ed43-40bf-bdfb-c4c44fbb8ca4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:08.697691 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-66e2cb45-ed43-40bf-bdfb-c4c44fbb8ca4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:08.698124 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-66e2cb45-ed43-40bf-bdfb-c4c44fbb8ca4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:08.699067 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-66e2cb45-ed43-40bf-bdfb-c4c44fbb8ca4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:08.699519 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-66e2cb45-ed43-40bf-bdfb-c4c44fbb8ca4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:08.699938 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-66e2cb45-ed43-40bf-bdfb-c4c44fbb8ca4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:08.714373 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-66e2cb45-ed43-40bf-bdfb-c4c44fbb8ca4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] HTTP exception thrown: Instance 975c9084-63da-4d0a-8d00-c5826621627b could not be found. Oct 30 01:06:08.716066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-66e2cb45-ed43-40bf-bdfb-c4c44fbb8ca4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Request method failure captured: Oct 30 01:06:08.716066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: DELETE /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b HTTP/1.1 Oct 30 01:06:08.716066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 01:06:08.716066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 01:06:08.716066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 01:06:08.716066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 01:06:08.716066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 01:06:08.716066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 01:06:08.716066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 01:06:08.716066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 01:06:08.716066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXcxY8meP6vvhjbMl5SDegLis0GNSJ-as78-NEFrPY5visYG6nAB9FJqsqSnKlmkLjDyOiz2t_9jR7dQbTJVad7Ot58e6fXvOwVA87-vsO9JQuc5io49RaVNBH3eRFW0SDeH6mC7M6KHqZYWVfoplDjyGh6d_VPsrjSppQ78VV6m9NHw Oct 30 01:06:08.716066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 01:06:08.716066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 01:06:08.716066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 01:06:08.716066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 01:06:08.716066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 01:06:08.716066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 01:06:08.716066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:06:08.716066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:08.716066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 01:06:08.716066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 01:06:08.717537 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:06:08.717537 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:08.717537 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:06:08.717537 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:08.717537 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:06:08.717537 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 01:06:08.717537 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 01:06:08.717537 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: 7353722ccb7548a6b92c89d4917fefaa Oct 30 01:06:08.717537 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:06:08.717537 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: > Oct 30 01:06:08.717537 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Instance 975c9084-63da-4d0a-8d00-c5826621627b could not be found. Oct 30 01:06:08.717537 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': '975c9084-63da-4d0a-8d00-c5826621627b'} Oct 30 01:06:08.718344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:06:08.718344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:08.718344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:06:08.718344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:06:08.718344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:06:08.718344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:06:08.718344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:06:08.718344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:06:08.718344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:06:08.718344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:06:08.718344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 975c9084-63da-4d0a-8d00-c5826621627b could not be found. Oct 30 01:06:08.718344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:08.718344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:08.718344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:08.718344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:08.718344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:08.718344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:08.718344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:06:08.718344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:06:08.718344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:06:08.720461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:06:08.720461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:06:08.720461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:06:08.720461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:06:08.720461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:06:08.720461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:06:08.720461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:06:08.720461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:06:08.720461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:06:08.720461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 975c9084-63da-4d0a-8d00-c5826621627b could not be found. Oct 30 01:06:08.720461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:08.720461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:08.720461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:08.720461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:08.720461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:08.720461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:08.720461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:06:08.720461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:06:08.720461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 975c9084-63da-4d0a-8d00-c5826621627b could not be found. Oct 30 01:06:08.720461 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:08.722330 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-66e2cb45-ed43-40bf-bdfb-c4c44fbb8ca4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Returning 404 to user: Instance 975c9084-63da-4d0a-8d00-c5826621627b could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:06:08.722330 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-66e2cb45-ed43-40bf-bdfb-c4c44fbb8ca4 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "DELETE /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b" status: 404 len: 111 microversion: 2.1 time: 0.032830 Oct 30 01:06:08.722330 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 541/1099] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 01:06:08 2022] DELETE /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:06:08.727255 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-214ca5d8-4ab0-4c6e-8d9b-0bd187ed22e9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:08.727862 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-214ca5d8-4ab0-4c6e-8d9b-0bd187ed22e9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: 975c9084-63da-4d0a-8d00-c5826621627b] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:08.734734 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-214ca5d8-4ab0-4c6e-8d9b-0bd187ed22e9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:08.735192 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-214ca5d8-4ab0-4c6e-8d9b-0bd187ed22e9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:08.735639 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-214ca5d8-4ab0-4c6e-8d9b-0bd187ed22e9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:08.736361 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-214ca5d8-4ab0-4c6e-8d9b-0bd187ed22e9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:08.736811 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-214ca5d8-4ab0-4c6e-8d9b-0bd187ed22e9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:08.737230 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-214ca5d8-4ab0-4c6e-8d9b-0bd187ed22e9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:08.750563 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-214ca5d8-4ab0-4c6e-8d9b-0bd187ed22e9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] HTTP exception thrown: Instance 975c9084-63da-4d0a-8d00-c5826621627b could not be found. Oct 30 01:06:08.752105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-214ca5d8-4ab0-4c6e-8d9b-0bd187ed22e9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Request method failure captured: Oct 30 01:06:08.752105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b HTTP/1.1 Oct 30 01:06:08.752105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 01:06:08.752105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 01:06:08.752105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 01:06:08.752105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 01:06:08.752105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 01:06:08.752105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 01:06:08.752105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 01:06:08.752105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 01:06:08.752105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcxY8meP6vvhjbMl5SDegLis0GNSJ-as78-NEFrPY5visYG6nAB9FJqsqSnKlmkLjDyOiz2t_9jR7dQbTJVad7Ot58e6fXvOwVA87-vsO9JQuc5io49RaVNBH3eRFW0SDeH6mC7M6KHqZYWVfoplDjyGh6d_VPsrjSppQ78VV6m9NHw Oct 30 01:06:08.752105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 01:06:08.752105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 01:06:08.752105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 01:06:08.752105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 01:06:08.752105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 01:06:08.752105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 01:06:08.752105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:06:08.752105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:08.752105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 01:06:08.752105 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 01:06:08.755041 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:06:08.755041 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:08.755041 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:06:08.755041 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:08.755041 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:06:08.755041 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 01:06:08.755041 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 01:06:08.755041 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 7353722ccb7548a6b92c89d4917fefaa Oct 30 01:06:08.755041 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:06:08.755041 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 01:06:08.755041 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Instance 975c9084-63da-4d0a-8d00-c5826621627b could not be found. Oct 30 01:06:08.755041 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': '975c9084-63da-4d0a-8d00-c5826621627b'} Oct 30 01:06:08.756185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:06:08.756185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:08.756185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:06:08.756185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:06:08.756185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:06:08.756185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:06:08.756185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:06:08.756185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:06:08.756185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:06:08.756185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:06:08.756185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 975c9084-63da-4d0a-8d00-c5826621627b could not be found. Oct 30 01:06:08.756185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:08.756185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:08.756185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:08.756185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:08.756185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:08.756185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:08.756185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:06:08.756185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:06:08.756185 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:06:08.758972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:06:08.758972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:06:08.758972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:06:08.758972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:06:08.758972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:06:08.758972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:06:08.758972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:06:08.758972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 975c9084-63da-4d0a-8d00-c5826621627b could not be found. Oct 30 01:06:08.758972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:08.758972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:08.758972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:08.758972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:08.758972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:08.758972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:08.758972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:06:08.758972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:06:08.758972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 975c9084-63da-4d0a-8d00-c5826621627b could not be found. Oct 30 01:06:08.758972 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:08.762426 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-214ca5d8-4ab0-4c6e-8d9b-0bd187ed22e9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Returning 404 to user: Instance 975c9084-63da-4d0a-8d00-c5826621627b could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:06:08.762426 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-214ca5d8-4ab0-4c6e-8d9b-0bd187ed22e9 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b" status: 404 len: 111 microversion: 2.1 time: 0.030091 Oct 30 01:06:08.762426 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 559/1100] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:06:08 2022] GET /compute/v2.1/servers/975c9084-63da-4d0a-8d00-c5826621627b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:06:08.778899 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-ffc140f3-0454-45e7-8ddc-ed4b98591eee tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:08.779427 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-ffc140f3-0454-45e7-8ddc-ed4b98591eee tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:08.786442 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ffc140f3-0454-45e7-8ddc-ed4b98591eee tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:08.786811 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ffc140f3-0454-45e7-8ddc-ed4b98591eee tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:08.787253 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ffc140f3-0454-45e7-8ddc-ed4b98591eee tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:08.788019 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ffc140f3-0454-45e7-8ddc-ed4b98591eee tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:08.788444 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ffc140f3-0454-45e7-8ddc-ed4b98591eee tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:08.788864 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ffc140f3-0454-45e7-8ddc-ed4b98591eee tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:08.957990 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ffc140f3-0454-45e7-8ddc-ed4b98591eee tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:06:08.965715 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-ffc140f3-0454-45e7-8ddc-ed4b98591eee tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 200 len: 1267 microversion: 2.1 time: 0.191078 Oct 30 01:06:08.966265 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 542/1101] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:06:08 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:06:09.904361 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7c9d7273-2e0f-4ab9-b577-c46f62b672bb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:09.904853 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-7c9d7273-2e0f-4ab9-b577-c46f62b672bb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:09.911344 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7c9d7273-2e0f-4ab9-b577-c46f62b672bb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:09.911823 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7c9d7273-2e0f-4ab9-b577-c46f62b672bb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:09.912299 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7c9d7273-2e0f-4ab9-b577-c46f62b672bb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:09.912985 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7c9d7273-2e0f-4ab9-b577-c46f62b672bb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:09.913436 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7c9d7273-2e0f-4ab9-b577-c46f62b672bb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:09.913859 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7c9d7273-2e0f-4ab9-b577-c46f62b672bb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:09.929952 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-7c9d7273-2e0f-4ab9-b577-c46f62b672bb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] HTTP exception thrown: Instance c5dcd920-bcaa-4627-9732-fbc5032e7c36 could not be found. Oct 30 01:06:09.931475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7c9d7273-2e0f-4ab9-b577-c46f62b672bb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Request method failure captured: Oct 30 01:06:09.931475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: DELETE /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36 HTTP/1.1 Oct 30 01:06:09.931475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 01:06:09.931475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 01:06:09.931475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 01:06:09.931475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 01:06:09.931475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 01:06:09.931475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 01:06:09.931475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 01:06:09.931475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 01:06:09.931475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcxY8meP6vvhjbMl5SDegLis0GNSJ-as78-NEFrPY5visYG6nAB9FJqsqSnKlmkLjDyOiz2t_9jR7dQbTJVad7Ot58e6fXvOwVA87-vsO9JQuc5io49RaVNBH3eRFW0SDeH6mC7M6KHqZYWVfoplDjyGh6d_VPsrjSppQ78VV6m9NHw Oct 30 01:06:09.931475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 01:06:09.931475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 01:06:09.931475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 01:06:09.931475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 01:06:09.931475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 01:06:09.931475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 01:06:09.931475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:06:09.931475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:09.931475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 01:06:09.931475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 01:06:09.932980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:06:09.932980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:09.932980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:06:09.932980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:09.932980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:06:09.932980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 01:06:09.932980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 01:06:09.932980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 7353722ccb7548a6b92c89d4917fefaa Oct 30 01:06:09.932980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:06:09.932980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 01:06:09.932980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Instance c5dcd920-bcaa-4627-9732-fbc5032e7c36 could not be found. Oct 30 01:06:09.932980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': 'c5dcd920-bcaa-4627-9732-fbc5032e7c36'} Oct 30 01:06:09.933781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:06:09.933781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:09.933781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:06:09.933781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:06:09.933781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:06:09.933781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:06:09.933781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:06:09.933781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:06:09.933781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:06:09.933781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:06:09.933781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5dcd920-bcaa-4627-9732-fbc5032e7c36 could not be found. Oct 30 01:06:09.933781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:09.933781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:09.933781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:09.933781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:09.933781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:09.933781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:09.933781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:06:09.933781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:06:09.933781 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:06:09.935046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:06:09.935046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:06:09.935046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:06:09.935046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:06:09.935046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:06:09.935046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:06:09.935046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:06:09.935046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:06:09.935046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:06:09.935046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5dcd920-bcaa-4627-9732-fbc5032e7c36 could not be found. Oct 30 01:06:09.935046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:09.935046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:09.935046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:09.935046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:09.935046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:09.935046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:09.935046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:06:09.935046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:06:09.935046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5dcd920-bcaa-4627-9732-fbc5032e7c36 could not be found. Oct 30 01:06:09.935046 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:09.936450 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7c9d7273-2e0f-4ab9-b577-c46f62b672bb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Returning 404 to user: Instance c5dcd920-bcaa-4627-9732-fbc5032e7c36 could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:06:09.936450 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7c9d7273-2e0f-4ab9-b577-c46f62b672bb tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36" status: 404 len: 111 microversion: 2.1 time: 0.032326 Oct 30 01:06:09.936450 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 560/1102] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 01:06:09 2022] DELETE /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:06:09.942182 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d7fb38b3-0dae-4fe6-9a46-0dce2abf8ae2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:09.942832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d7fb38b3-0dae-4fe6-9a46-0dce2abf8ae2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: c5dcd920-bcaa-4627-9732-fbc5032e7c36] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:09.949446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d7fb38b3-0dae-4fe6-9a46-0dce2abf8ae2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:09.949917 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d7fb38b3-0dae-4fe6-9a46-0dce2abf8ae2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:09.950344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d7fb38b3-0dae-4fe6-9a46-0dce2abf8ae2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:09.951032 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d7fb38b3-0dae-4fe6-9a46-0dce2abf8ae2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:09.951481 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d7fb38b3-0dae-4fe6-9a46-0dce2abf8ae2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:09.951898 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d7fb38b3-0dae-4fe6-9a46-0dce2abf8ae2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:09.965315 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-d7fb38b3-0dae-4fe6-9a46-0dce2abf8ae2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] HTTP exception thrown: Instance c5dcd920-bcaa-4627-9732-fbc5032e7c36 could not be found. Oct 30 01:06:09.966815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d7fb38b3-0dae-4fe6-9a46-0dce2abf8ae2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Request method failure captured: Oct 30 01:06:09.966815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36 HTTP/1.1 Oct 30 01:06:09.966815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 01:06:09.966815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 01:06:09.966815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 01:06:09.966815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 01:06:09.966815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 01:06:09.966815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 01:06:09.966815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 01:06:09.966815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 01:06:09.966815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXcxY8meP6vvhjbMl5SDegLis0GNSJ-as78-NEFrPY5visYG6nAB9FJqsqSnKlmkLjDyOiz2t_9jR7dQbTJVad7Ot58e6fXvOwVA87-vsO9JQuc5io49RaVNBH3eRFW0SDeH6mC7M6KHqZYWVfoplDjyGh6d_VPsrjSppQ78VV6m9NHw Oct 30 01:06:09.966815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 01:06:09.966815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 01:06:09.966815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 01:06:09.966815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 01:06:09.966815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 01:06:09.966815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 01:06:09.966815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:06:09.966815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:09.966815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 01:06:09.966815 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 01:06:09.969007 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:06:09.969007 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:09.969007 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:06:09.969007 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:09.969007 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:06:09.969007 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 01:06:09.969007 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 01:06:09.969007 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: 7353722ccb7548a6b92c89d4917fefaa Oct 30 01:06:09.969007 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:06:09.969007 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: > Oct 30 01:06:09.969007 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Instance c5dcd920-bcaa-4627-9732-fbc5032e7c36 could not be found. Oct 30 01:06:09.969007 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': 'c5dcd920-bcaa-4627-9732-fbc5032e7c36'} Oct 30 01:06:09.969987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:06:09.969987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:09.969987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:06:09.969987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:06:09.969987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:06:09.969987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:06:09.969987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:06:09.969987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:06:09.969987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:06:09.969987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:06:09.969987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5dcd920-bcaa-4627-9732-fbc5032e7c36 could not be found. Oct 30 01:06:09.969987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:09.969987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:09.969987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:09.969987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:09.969987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:09.969987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:09.969987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:06:09.969987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:06:09.969987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:06:09.971466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:06:09.971466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:06:09.971466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:06:09.971466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:06:09.971466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:06:09.971466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:06:09.971466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:06:09.971466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5dcd920-bcaa-4627-9732-fbc5032e7c36 could not be found. Oct 30 01:06:09.971466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:09.971466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:09.971466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:09.971466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:09.971466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:09.971466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:09.971466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:06:09.971466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:06:09.971466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5dcd920-bcaa-4627-9732-fbc5032e7c36 could not be found. Oct 30 01:06:09.971466 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:09.972865 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d7fb38b3-0dae-4fe6-9a46-0dce2abf8ae2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Returning 404 to user: Instance c5dcd920-bcaa-4627-9732-fbc5032e7c36 could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:06:09.972865 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d7fb38b3-0dae-4fe6-9a46-0dce2abf8ae2 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36" status: 404 len: 111 microversion: 2.1 time: 0.030788 Oct 30 01:06:09.972865 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 543/1103] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:06:09 2022] GET /compute/v2.1/servers/c5dcd920-bcaa-4627-9732-fbc5032e7c36 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:06:09.976635 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-dac82c39-234e-4c4a-b1f8-32b7a5a3829b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:09.977128 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-dac82c39-234e-4c4a-b1f8-32b7a5a3829b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: ce0e4e1c-608e-4056-9d3b-1451ac41e206] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:09.983023 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-dac82c39-234e-4c4a-b1f8-32b7a5a3829b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:09.983499 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-dac82c39-234e-4c4a-b1f8-32b7a5a3829b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:09.984488 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-dac82c39-234e-4c4a-b1f8-32b7a5a3829b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:09.985333 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-dac82c39-234e-4c4a-b1f8-32b7a5a3829b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:09.985787 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-dac82c39-234e-4c4a-b1f8-32b7a5a3829b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:09.986204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-dac82c39-234e-4c4a-b1f8-32b7a5a3829b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:09.989195 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f154371e-efb5-4fc2-9911-8fc1a5203753 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:09.989794 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f154371e-efb5-4fc2-9911-8fc1a5203753 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:09.990348 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:09.996514 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f154371e-efb5-4fc2-9911-8fc1a5203753 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:09.996991 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f154371e-efb5-4fc2-9911-8fc1a5203753 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:09.997418 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f154371e-efb5-4fc2-9911-8fc1a5203753 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:09.998106 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f154371e-efb5-4fc2-9911-8fc1a5203753 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:09.998554 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f154371e-efb5-4fc2-9911-8fc1a5203753 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:09.998974 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f154371e-efb5-4fc2-9911-8fc1a5203753 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:10.001220 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-dac82c39-234e-4c4a-b1f8-32b7a5a3829b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] HTTP exception thrown: Instance ce0e4e1c-608e-4056-9d3b-1451ac41e206 could not be found. Oct 30 01:06:10.003710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-dac82c39-234e-4c4a-b1f8-32b7a5a3829b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Request method failure captured: Oct 30 01:06:10.003710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: DELETE /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206 HTTP/1.1 Oct 30 01:06:10.003710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 01:06:10.003710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 01:06:10.003710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 01:06:10.003710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 01:06:10.003710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 01:06:10.003710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 01:06:10.003710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 01:06:10.003710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 01:06:10.003710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcxY8meP6vvhjbMl5SDegLis0GNSJ-as78-NEFrPY5visYG6nAB9FJqsqSnKlmkLjDyOiz2t_9jR7dQbTJVad7Ot58e6fXvOwVA87-vsO9JQuc5io49RaVNBH3eRFW0SDeH6mC7M6KHqZYWVfoplDjyGh6d_VPsrjSppQ78VV6m9NHw Oct 30 01:06:10.003710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 01:06:10.003710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 01:06:10.003710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 01:06:10.003710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 01:06:10.003710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 01:06:10.003710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 01:06:10.003710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:06:10.003710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:10.003710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 01:06:10.003710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 01:06:10.006245 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:06:10.006245 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:10.006245 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:06:10.006245 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:10.006245 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:06:10.006245 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 01:06:10.006245 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 01:06:10.006245 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 7353722ccb7548a6b92c89d4917fefaa Oct 30 01:06:10.006245 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:06:10.006245 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 01:06:10.006245 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Instance ce0e4e1c-608e-4056-9d3b-1451ac41e206 could not be found. Oct 30 01:06:10.006245 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': 'ce0e4e1c-608e-4056-9d3b-1451ac41e206'} Oct 30 01:06:10.007352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:06:10.007352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:10.007352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:06:10.007352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:06:10.007352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:06:10.007352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:06:10.007352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:06:10.007352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:06:10.007352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:06:10.007352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:06:10.007352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce0e4e1c-608e-4056-9d3b-1451ac41e206 could not be found. Oct 30 01:06:10.007352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:10.007352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:10.007352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:10.007352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:10.007352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:10.007352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:10.007352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:06:10.007352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:06:10.007352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:06:10.009113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:06:10.009113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:06:10.009113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:06:10.009113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:06:10.009113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:06:10.009113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:06:10.009113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:06:10.009113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:06:10.009113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:06:10.009113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce0e4e1c-608e-4056-9d3b-1451ac41e206 could not be found. Oct 30 01:06:10.009113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:10.009113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:10.009113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:10.009113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:10.009113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:10.009113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:10.009113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:06:10.009113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:06:10.009113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce0e4e1c-608e-4056-9d3b-1451ac41e206 could not be found. Oct 30 01:06:10.009113 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:10.010721 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-dac82c39-234e-4c4a-b1f8-32b7a5a3829b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Returning 404 to user: Instance ce0e4e1c-608e-4056-9d3b-1451ac41e206 could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:06:10.010721 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-dac82c39-234e-4c4a-b1f8-32b7a5a3829b tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206" status: 404 len: 111 microversion: 2.1 time: 0.033983 Oct 30 01:06:10.010721 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 561/1104] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 01:06:09 2022] DELETE /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:06:10.015227 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-bbef1d39-72cc-4e85-8044-e37914a78d26 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:10.015990 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-bbef1d39-72cc-4e85-8044-e37914a78d26 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: ce0e4e1c-608e-4056-9d3b-1451ac41e206] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:10.024061 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bbef1d39-72cc-4e85-8044-e37914a78d26 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:10.024969 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bbef1d39-72cc-4e85-8044-e37914a78d26 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:10.025796 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bbef1d39-72cc-4e85-8044-e37914a78d26 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:10.027028 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bbef1d39-72cc-4e85-8044-e37914a78d26 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:10.027851 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bbef1d39-72cc-4e85-8044-e37914a78d26 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:10.028669 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bbef1d39-72cc-4e85-8044-e37914a78d26 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:10.045805 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-bbef1d39-72cc-4e85-8044-e37914a78d26 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] HTTP exception thrown: Instance ce0e4e1c-608e-4056-9d3b-1451ac41e206 could not be found. Oct 30 01:06:10.048226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-bbef1d39-72cc-4e85-8044-e37914a78d26 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Request method failure captured: Oct 30 01:06:10.048226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206 HTTP/1.1 Oct 30 01:06:10.048226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 01:06:10.048226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 01:06:10.048226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 01:06:10.048226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 01:06:10.048226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 01:06:10.048226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 01:06:10.048226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 01:06:10.048226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 01:06:10.048226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcxY8meP6vvhjbMl5SDegLis0GNSJ-as78-NEFrPY5visYG6nAB9FJqsqSnKlmkLjDyOiz2t_9jR7dQbTJVad7Ot58e6fXvOwVA87-vsO9JQuc5io49RaVNBH3eRFW0SDeH6mC7M6KHqZYWVfoplDjyGh6d_VPsrjSppQ78VV6m9NHw Oct 30 01:06:10.048226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 01:06:10.048226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 01:06:10.048226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 01:06:10.048226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 01:06:10.048226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 01:06:10.048226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 01:06:10.048226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:06:10.048226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:10.048226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 01:06:10.048226 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 01:06:10.049928 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:06:10.049928 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:10.049928 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:06:10.049928 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:10.049928 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:06:10.049928 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 01:06:10.049928 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 01:06:10.049928 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 7353722ccb7548a6b92c89d4917fefaa Oct 30 01:06:10.049928 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:06:10.049928 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 01:06:10.049928 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Instance ce0e4e1c-608e-4056-9d3b-1451ac41e206 could not be found. Oct 30 01:06:10.049928 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': 'ce0e4e1c-608e-4056-9d3b-1451ac41e206'} Oct 30 01:06:10.050769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:06:10.050769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:10.050769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:06:10.050769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:06:10.050769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:06:10.050769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:06:10.050769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:06:10.050769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:06:10.050769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:06:10.050769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:06:10.050769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce0e4e1c-608e-4056-9d3b-1451ac41e206 could not be found. Oct 30 01:06:10.050769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:10.050769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:10.050769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:10.050769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:10.050769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:10.050769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:10.050769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:06:10.050769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:06:10.050769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:06:10.052052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:06:10.052052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:06:10.052052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:06:10.052052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:06:10.052052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:06:10.052052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:06:10.052052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:06:10.052052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce0e4e1c-608e-4056-9d3b-1451ac41e206 could not be found. Oct 30 01:06:10.052052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:10.052052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:10.052052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:10.052052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:10.052052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:10.052052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:10.052052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:06:10.052052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:06:10.052052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce0e4e1c-608e-4056-9d3b-1451ac41e206 could not be found. Oct 30 01:06:10.052052 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:10.053247 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-bbef1d39-72cc-4e85-8044-e37914a78d26 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Returning 404 to user: Instance ce0e4e1c-608e-4056-9d3b-1451ac41e206 could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:06:10.053247 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-bbef1d39-72cc-4e85-8044-e37914a78d26 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206" status: 404 len: 111 microversion: 2.1 time: 0.038420 Oct 30 01:06:10.053247 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 562/1105] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:06:10 2022] GET /compute/v2.1/servers/ce0e4e1c-608e-4056-9d3b-1451ac41e206 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:06:10.148445 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f154371e-efb5-4fc2-9911-8fc1a5203753 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:06:10.161788 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f154371e-efb5-4fc2-9911-8fc1a5203753 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 200 len: 1267 microversion: 2.1 time: 0.176143 Oct 30 01:06:10.162388 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 544/1106] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:06:09 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:06:10.860633 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-ea76a626-0db7-437c-9c37-8143c1dac34c req-2c850fc5-2f55-468e-a7d9-81aaa6ec8a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb312adb-3d03-43c7-aadf-adc7cc771e65", "name": "network-vif-plugged", "status": "completed", "tag": "d30b3add-32a3-4ae5-8567-e6dd0db6daa5"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:06:10.872966 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-ea76a626-0db7-437c-9c37-8143c1dac34c req-2c850fc5-2f55-468e-a7d9-81aaa6ec8a73 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:10.872966 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-ea76a626-0db7-437c-9c37-8143c1dac34c req-2c850fc5-2f55-468e-a7d9-81aaa6ec8a73 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:10.872966 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-ea76a626-0db7-437c-9c37-8143c1dac34c req-2c850fc5-2f55-468e-a7d9-81aaa6ec8a73 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:10.884553 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-ea76a626-0db7-437c-9c37-8143c1dac34c req-2c850fc5-2f55-468e-a7d9-81aaa6ec8a73 service nova] Creating event network-vif-plugged:d30b3add-32a3-4ae5-8567-e6dd0db6daa5 for instance eb312adb-3d03-43c7-aadf-adc7cc771e65 on hv-cinder-86149 Oct 30 01:06:10.889671 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-ea76a626-0db7-437c-9c37-8143c1dac34c req-2c850fc5-2f55-468e-a7d9-81aaa6ec8a73 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091908 Oct 30 01:06:10.890255 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 563/1107] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:06:11.184749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-66951a6a-d03d-4a95-98cf-1e44e56e45ef tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:11.185361 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-66951a6a-d03d-4a95-98cf-1e44e56e45ef tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:11.193158 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-66951a6a-d03d-4a95-98cf-1e44e56e45ef tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:11.193663 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-66951a6a-d03d-4a95-98cf-1e44e56e45ef tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:11.193983 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-a6a387b8-c01c-468c-8bb2-b83ecd35e777 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:11.194427 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-66951a6a-d03d-4a95-98cf-1e44e56e45ef tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:11.194612 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-a6a387b8-c01c-468c-8bb2-b83ecd35e777 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:11.195378 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-66951a6a-d03d-4a95-98cf-1e44e56e45ef tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:11.195872 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-66951a6a-d03d-4a95-98cf-1e44e56e45ef tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:11.196327 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-66951a6a-d03d-4a95-98cf-1e44e56e45ef tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:11.200957 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a6a387b8-c01c-468c-8bb2-b83ecd35e777 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:11.201429 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a6a387b8-c01c-468c-8bb2-b83ecd35e777 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:11.201854 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a6a387b8-c01c-468c-8bb2-b83ecd35e777 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:11.202533 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a6a387b8-c01c-468c-8bb2-b83ecd35e777 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:11.202975 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a6a387b8-c01c-468c-8bb2-b83ecd35e777 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:11.203392 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a6a387b8-c01c-468c-8bb2-b83ecd35e777 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:11.216395 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-a6a387b8-c01c-468c-8bb2-b83ecd35e777 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] HTTP exception thrown: Instance fcef108b-3362-4ede-8646-9b25d0cd5d33 could not be found. Oct 30 01:06:11.218037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-a6a387b8-c01c-468c-8bb2-b83ecd35e777 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Request method failure captured: Oct 30 01:06:11.218037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: DELETE /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33 HTTP/1.1 Oct 30 01:06:11.218037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 01:06:11.218037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 01:06:11.218037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 01:06:11.218037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 01:06:11.218037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 01:06:11.218037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 01:06:11.218037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 01:06:11.218037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 01:06:11.218037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcxY8meP6vvhjbMl5SDegLis0GNSJ-as78-NEFrPY5visYG6nAB9FJqsqSnKlmkLjDyOiz2t_9jR7dQbTJVad7Ot58e6fXvOwVA87-vsO9JQuc5io49RaVNBH3eRFW0SDeH6mC7M6KHqZYWVfoplDjyGh6d_VPsrjSppQ78VV6m9NHw Oct 30 01:06:11.218037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 01:06:11.218037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 01:06:11.218037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 01:06:11.218037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 01:06:11.218037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 01:06:11.218037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 01:06:11.218037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:06:11.218037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:11.218037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 01:06:11.218037 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 01:06:11.220444 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:06:11.220444 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:11.220444 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:06:11.220444 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:11.220444 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:06:11.220444 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 01:06:11.220444 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 01:06:11.220444 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 7353722ccb7548a6b92c89d4917fefaa Oct 30 01:06:11.220444 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:06:11.220444 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 01:06:11.220444 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Instance fcef108b-3362-4ede-8646-9b25d0cd5d33 could not be found. Oct 30 01:06:11.220444 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': 'fcef108b-3362-4ede-8646-9b25d0cd5d33'} Oct 30 01:06:11.221564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:06:11.221564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:11.221564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:06:11.221564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:06:11.221564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:06:11.221564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:06:11.221564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:06:11.221564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:06:11.221564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:06:11.221564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:06:11.221564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcef108b-3362-4ede-8646-9b25d0cd5d33 could not be found. Oct 30 01:06:11.221564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:11.221564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:11.221564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:11.221564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:11.221564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:11.221564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:11.221564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:06:11.221564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:06:11.221564 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:06:11.223187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:06:11.223187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:06:11.223187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:06:11.223187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:06:11.223187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:06:11.223187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:06:11.223187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:06:11.223187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:06:11.223187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:06:11.223187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcef108b-3362-4ede-8646-9b25d0cd5d33 could not be found. Oct 30 01:06:11.223187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:11.223187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:11.223187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:11.223187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:11.223187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:11.223187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:11.223187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:06:11.223187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:06:11.223187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcef108b-3362-4ede-8646-9b25d0cd5d33 could not be found. Oct 30 01:06:11.223187 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:11.224968 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-a6a387b8-c01c-468c-8bb2-b83ecd35e777 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Returning 404 to user: Instance fcef108b-3362-4ede-8646-9b25d0cd5d33 could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:06:11.224968 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-a6a387b8-c01c-468c-8bb2-b83ecd35e777 tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33" status: 404 len: 111 microversion: 2.1 time: 0.030732 Oct 30 01:06:11.224968 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 564/1108] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 01:06:11 2022] DELETE /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:06:11.228104 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4809c2b3-ead4-47dd-ab3e-9891efe9f6bf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:11.228700 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-4809c2b3-ead4-47dd-ab3e-9891efe9f6bf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] [instance: fcef108b-3362-4ede-8646-9b25d0cd5d33] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:11.235043 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4809c2b3-ead4-47dd-ab3e-9891efe9f6bf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:11.235513 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4809c2b3-ead4-47dd-ab3e-9891efe9f6bf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:11.235934 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4809c2b3-ead4-47dd-ab3e-9891efe9f6bf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:11.236648 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4809c2b3-ead4-47dd-ab3e-9891efe9f6bf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:11.237099 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4809c2b3-ead4-47dd-ab3e-9891efe9f6bf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:11.237569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-4809c2b3-ead4-47dd-ab3e-9891efe9f6bf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:11.251461 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-4809c2b3-ead4-47dd-ab3e-9891efe9f6bf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] HTTP exception thrown: Instance fcef108b-3362-4ede-8646-9b25d0cd5d33 could not be found. Oct 30 01:06:11.253006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4809c2b3-ead4-47dd-ab3e-9891efe9f6bf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Request method failure captured: Oct 30 01:06:11.253006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33 HTTP/1.1 Oct 30 01:06:11.253006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 01:06:11.253006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 01:06:11.253006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 01:06:11.253006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 01:06:11.253006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 01:06:11.253006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 01:06:11.253006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 01:06:11.253006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 01:06:11.253006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXcxY8meP6vvhjbMl5SDegLis0GNSJ-as78-NEFrPY5visYG6nAB9FJqsqSnKlmkLjDyOiz2t_9jR7dQbTJVad7Ot58e6fXvOwVA87-vsO9JQuc5io49RaVNBH3eRFW0SDeH6mC7M6KHqZYWVfoplDjyGh6d_VPsrjSppQ78VV6m9NHw Oct 30 01:06:11.253006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 01:06:11.253006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 01:06:11.253006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 01:06:11.253006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 01:06:11.253006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 01:06:11.253006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 01:06:11.253006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:06:11.253006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:11.253006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 01:06:11.253006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 01:06:11.254657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc70ef555fc84a51b3521007d00b77e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:06:11.254657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:11.254657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: dc70ef555fc84a51b3521007d00b77e3 Oct 30 01:06:11.254657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1924421858 Oct 30 01:06:11.254657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:06:11.254657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 01:06:11.254657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 01:06:11.254657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: 7353722ccb7548a6b92c89d4917fefaa Oct 30 01:06:11.254657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-AttachVolumeNegativeTest-1924421858-project Oct 30 01:06:11.254657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 01:06:11.254657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Instance fcef108b-3362-4ede-8646-9b25d0cd5d33 could not be found. Oct 30 01:06:11.254657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': 'fcef108b-3362-4ede-8646-9b25d0cd5d33'} Oct 30 01:06:11.255580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:06:11.255580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:11.255580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:06:11.255580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:06:11.255580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:06:11.255580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:06:11.255580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:06:11.255580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:06:11.255580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:06:11.255580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:06:11.255580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcef108b-3362-4ede-8646-9b25d0cd5d33 could not be found. Oct 30 01:06:11.255580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:11.255580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:11.255580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:11.255580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:11.255580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:11.255580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:11.255580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:06:11.255580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:06:11.255580 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:06:11.257042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:06:11.257042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:06:11.257042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:06:11.257042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:06:11.257042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:06:11.257042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:06:11.257042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:06:11.257042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcef108b-3362-4ede-8646-9b25d0cd5d33 could not be found. Oct 30 01:06:11.257042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:11.257042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:11.257042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:11.257042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:11.257042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:11.257042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:11.257042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:06:11.257042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:06:11.257042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcef108b-3362-4ede-8646-9b25d0cd5d33 could not be found. Oct 30 01:06:11.257042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:11.258326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-4809c2b3-ead4-47dd-ab3e-9891efe9f6bf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] Returning 404 to user: Instance fcef108b-3362-4ede-8646-9b25d0cd5d33 could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:06:11.258326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-4809c2b3-ead4-47dd-ab3e-9891efe9f6bf tempest-AttachVolumeNegativeTest-1924421858 tempest-AttachVolumeNegativeTest-1924421858-project] 10.222.0.36 "GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33" status: 404 len: 111 microversion: 2.1 time: 0.029790 Oct 30 01:06:11.258494 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 565/1109] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:06:11 2022] GET /compute/v2.1/servers/fcef108b-3362-4ede-8646-9b25d0cd5d33 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 30 01:06:11.330793 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-66951a6a-d03d-4a95-98cf-1e44e56e45ef tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:06:11.338690 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-66951a6a-d03d-4a95-98cf-1e44e56e45ef tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 200 len: 1267 microversion: 2.1 time: 0.157691 Oct 30 01:06:11.339250 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 545/1110] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:06:11 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:06:12.362214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-30de7aa7-206a-42d4-89e4-f72d5862e88d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:12.362838 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-30de7aa7-206a-42d4-89e4-f72d5862e88d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:12.369389 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30de7aa7-206a-42d4-89e4-f72d5862e88d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:12.369864 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30de7aa7-206a-42d4-89e4-f72d5862e88d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:12.370290 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30de7aa7-206a-42d4-89e4-f72d5862e88d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:12.370977 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30de7aa7-206a-42d4-89e4-f72d5862e88d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:12.371420 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30de7aa7-206a-42d4-89e4-f72d5862e88d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:12.371836 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-30de7aa7-206a-42d4-89e4-f72d5862e88d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:12.519632 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-30de7aa7-206a-42d4-89e4-f72d5862e88d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:06:12.530064 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-30de7aa7-206a-42d4-89e4-f72d5862e88d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 200 len: 1267 microversion: 2.1 time: 0.171851 Oct 30 01:06:12.531413 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 566/1111] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:06:12 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:06:13.555319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-ad542571-6a57-4324-a695-9abf7c151c88 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:13.555936 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-ad542571-6a57-4324-a695-9abf7c151c88 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:13.563588 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ad542571-6a57-4324-a695-9abf7c151c88 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:13.564226 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ad542571-6a57-4324-a695-9abf7c151c88 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:13.564737 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ad542571-6a57-4324-a695-9abf7c151c88 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:13.565580 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ad542571-6a57-4324-a695-9abf7c151c88 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:13.566272 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ad542571-6a57-4324-a695-9abf7c151c88 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:13.566958 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ad542571-6a57-4324-a695-9abf7c151c88 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:13.827766 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ad542571-6a57-4324-a695-9abf7c151c88 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:06:13.837171 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-ad542571-6a57-4324-a695-9abf7c151c88 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 200 len: 1454 microversion: 2.1 time: 0.286492 Oct 30 01:06:13.837739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 546/1112] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:06:13 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 1454 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:06:13.859740 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-5c5172a5-71fb-4694-a70d-6d3e298ad643 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:13.860295 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-5c5172a5-71fb-4694-a70d-6d3e298ad643 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:06:13.866677 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5c5172a5-71fb-4694-a70d-6d3e298ad643 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:13.867157 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5c5172a5-71fb-4694-a70d-6d3e298ad643 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:13.867586 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5c5172a5-71fb-4694-a70d-6d3e298ad643 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:13.872508 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5c5172a5-71fb-4694-a70d-6d3e298ad643 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:13.872508 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5c5172a5-71fb-4694-a70d-6d3e298ad643 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:13.872508 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5c5172a5-71fb-4694-a70d-6d3e298ad643 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:14.081654 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-5c5172a5-71fb-4694-a70d-6d3e298ad643 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:06:14.095056 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-5c5172a5-71fb-4694-a70d-6d3e298ad643 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 200 len: 1454 microversion: 2.1 time: 0.239623 Oct 30 01:06:14.095643 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 567/1113] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:06:13 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 1454 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:06:15.941605 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-fc237a90-8fcc-46ee-8d42-8a268a919f02 req-0f1ee20b-2321-445b-a565-b325660ffcc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb312adb-3d03-43c7-aadf-adc7cc771e65", "tag": "d30b3add-32a3-4ae5-8567-e6dd0db6daa5"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:06:15.956866 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-fc237a90-8fcc-46ee-8d42-8a268a919f02 req-0f1ee20b-2321-445b-a565-b325660ffcc5 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:06:15.957355 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-fc237a90-8fcc-46ee-8d42-8a268a919f02 req-0f1ee20b-2321-445b-a565-b325660ffcc5 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:06:15.958975 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-fc237a90-8fcc-46ee-8d42-8a268a919f02 req-0f1ee20b-2321-445b-a565-b325660ffcc5 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:06:15.972894 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-fc237a90-8fcc-46ee-8d42-8a268a919f02 req-0f1ee20b-2321-445b-a565-b325660ffcc5 service nova] Creating event network-changed:d30b3add-32a3-4ae5-8567-e6dd0db6daa5 for instance eb312adb-3d03-43c7-aadf-adc7cc771e65 on hv-cinder-86149 Oct 30 01:06:15.978421 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-fc237a90-8fcc-46ee-8d42-8a268a919f02 req-0f1ee20b-2321-445b-a565-b325660ffcc5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043164 Oct 30 01:06:15.979011 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 547/1114] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:06:16.118390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-46df9879-91ff-4e48-8a68-02b4a58dbfd0 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Action: 'create', calling method: .version_select at 0x7faf794724c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1020613175"}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:06:16.458317 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-46df9879-91ff-4e48-8a68-02b4a58dbfd0 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.469903 Oct 30 01:06:16.467858 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 568/1115] 10.222.0.36 () {60 vars in 1155 bytes} [Sun Oct 30 01:06:15 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 480 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 30 01:06:16.473830 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-adfe7d5f-30f0-44a3-b555-cb9e5d150b4c tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Calling method '.version_select at 0x7faf75c04a60>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:16.552986 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-adfe7d5f-30f0-44a3-b555-cb9e5d150b4c tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b21828a7-9bed-413b-9ea4-1051ac55dccc" status: 200 len: 345 microversion: 2.1 time: 0.083294 Oct 30 01:06:16.554275 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 548/1116] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Oct 30 01:06:16 2022] GET /compute/v2.1/os-volumes/b21828a7-9bed-413b-9ea4-1051ac55dccc => generated 345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:06:17.569002 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c3f58846-5b9e-4c69-aaf8-51b94b7aaaf0 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Calling method '.version_select at 0x7faf79253b80>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:17.617587 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c3f58846-5b9e-4c69-aaf8-51b94b7aaaf0 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b21828a7-9bed-413b-9ea4-1051ac55dccc" status: 200 len: 346 microversion: 2.1 time: 0.052820 Oct 30 01:06:17.618144 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 569/1117] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Oct 30 01:06:17 2022] GET /compute/v2.1/os-volumes/b21828a7-9bed-413b-9ea4-1051ac55dccc => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:06:17.633525 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-83be959c-6326-4ab7-851b-4d0d285605b9 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Action: 'create', calling method: .version_select at 0x7faf75bdcf70>, body: {"snapshot": {"volume_id": "b21828a7-9bed-413b-9ea4-1051ac55dccc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-654199678"}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:06:17.778465 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-83be959c-6326-4ab7-851b-4d0d285605b9 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.149207 Oct 30 01:06:17.779047 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 549/1118] 10.222.0.36 () {60 vars in 1162 bytes} [Sun Oct 30 01:06:17 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:06:17.791544 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d9ff1732-0024-4424-aef2-930298fb0b50 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Calling method '.version_select at 0x7faf793b9310>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:17.821342 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-d9ff1732-0024-4424-aef2-930298fb0b50 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/961e714e-319f-4655-a552-92a9a9b6d10b" status: 200 len: 286 microversion: 2.1 time: 0.033966 Oct 30 01:06:17.822137 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 570/1119] 10.222.0.36 () {58 vars in 1251 bytes} [Sun Oct 30 01:06:17 2022] GET /compute/v2.1/os-snapshots/961e714e-319f-4655-a552-92a9a9b6d10b => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:06:17.833441 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-96659da6-9ee3-4581-9d1a-e5cd873b2615 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Calling method '.version_select at 0x7faf75caf040>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:17.864908 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-96659da6-9ee3-4581-9d1a-e5cd873b2615 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.035244 Oct 30 01:06:17.865497 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 550/1120] 10.222.0.36 () {58 vars in 1140 bytes} [Sun Oct 30 01:06:17 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:06:17.877200 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-1998bc77-1b49-4393-b7aa-2e65f7855be9 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Calling method '.version_select at 0x7faf75757700>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:17.906631 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-1998bc77-1b49-4393-b7aa-2e65f7855be9 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/961e714e-319f-4655-a552-92a9a9b6d10b" status: 200 len: 286 microversion: 2.1 time: 0.033671 Oct 30 01:06:17.907189 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 571/1121] 10.222.0.36 () {58 vars in 1251 bytes} [Sun Oct 30 01:06:17 2022] GET /compute/v2.1/os-snapshots/961e714e-319f-4655-a552-92a9a9b6d10b => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:06:18.919950 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-cf62c48e-5a5d-424c-8f61-06fcf2bf09b7 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Calling method '.version_select at 0x7faf75c04c10>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:18.951125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-cf62c48e-5a5d-424c-8f61-06fcf2bf09b7 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/961e714e-319f-4655-a552-92a9a9b6d10b" status: 200 len: 286 microversion: 2.1 time: 0.035441 Oct 30 01:06:18.951674 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 551/1122] 10.222.0.36 () {58 vars in 1251 bytes} [Sun Oct 30 01:06:18 2022] GET /compute/v2.1/os-snapshots/961e714e-319f-4655-a552-92a9a9b6d10b => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:06:19.964923 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2a94da62-b21a-4d32-9271-94643c90d101 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Calling method '.version_select at 0x7faf79327280>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:19.994532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2a94da62-b21a-4d32-9271-94643c90d101 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/961e714e-319f-4655-a552-92a9a9b6d10b" status: 200 len: 286 microversion: 2.1 time: 0.033931 Oct 30 01:06:19.995080 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 572/1123] 10.222.0.36 () {58 vars in 1251 bytes} [Sun Oct 30 01:06:19 2022] GET /compute/v2.1/os-snapshots/961e714e-319f-4655-a552-92a9a9b6d10b => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:06:21.008361 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-07039f03-ad23-4ca6-a542-911f99a84898 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Calling method '.version_select at 0x7faf75c39d30>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:21.038191 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-07039f03-ad23-4ca6-a542-911f99a84898 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/961e714e-319f-4655-a552-92a9a9b6d10b" status: 200 len: 286 microversion: 2.1 time: 0.034142 Oct 30 01:06:21.038738 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 552/1124] 10.222.0.36 () {58 vars in 1251 bytes} [Sun Oct 30 01:06:21 2022] GET /compute/v2.1/os-snapshots/961e714e-319f-4655-a552-92a9a9b6d10b => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:06:22.051635 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d5f2bb45-ee78-4026-9110-146efdb12fe4 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Calling method '.version_select at 0x7faf7943c9d0>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:22.083866 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-d5f2bb45-ee78-4026-9110-146efdb12fe4 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/961e714e-319f-4655-a552-92a9a9b6d10b" status: 200 len: 287 microversion: 2.1 time: 0.036820 Oct 30 01:06:22.084471 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 573/1125] 10.222.0.36 () {58 vars in 1251 bytes} [Sun Oct 30 01:06:22 2022] GET /compute/v2.1/os-snapshots/961e714e-319f-4655-a552-92a9a9b6d10b => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:06:22.096832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-9e33cdf5-396c-4396-aa02-189c91dd0a42 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Calling method '.version_select at 0x7faf75c5daf0>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:22.158432 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-9e33cdf5-396c-4396-aa02-189c91dd0a42 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/961e714e-319f-4655-a552-92a9a9b6d10b" status: 202 len: 0 microversion: 2.1 time: 0.066565 Oct 30 01:06:22.158984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 553/1126] 10.222.0.36 () {58 vars in 1254 bytes} [Sun Oct 30 01:06:22 2022] DELETE /compute/v2.1/os-snapshots/961e714e-319f-4655-a552-92a9a9b6d10b => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:06:22.167374 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-21fbc2ff-a5f6-4f5c-b74b-779734541d3b tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Calling method '.version_select at 0x7faf792538b0>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:22.196874 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-21fbc2ff-a5f6-4f5c-b74b-779734541d3b tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/961e714e-319f-4655-a552-92a9a9b6d10b" status: 200 len: 286 microversion: 2.1 time: 0.033543 Oct 30 01:06:22.197499 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 574/1127] 10.222.0.36 () {58 vars in 1251 bytes} [Sun Oct 30 01:06:22 2022] GET /compute/v2.1/os-snapshots/961e714e-319f-4655-a552-92a9a9b6d10b => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:06:23.211110 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-83273d64-8494-4de2-b692-721f8fe8a301 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Calling method '.version_select at 0x7faf75c39a60>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:23.236707 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-83273d64-8494-4de2-b692-721f8fe8a301 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] HTTP exception thrown: Snapshot 961e714e-319f-4655-a552-92a9a9b6d10b could not be found. Oct 30 01:06:23.239002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-83273d64-8494-4de2-b692-721f8fe8a301 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Request method failure captured: Oct 30 01:06:23.239002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: GET /compute/v2.1/os-snapshots/961e714e-319f-4655-a552-92a9a9b6d10b HTTP/1.1 Oct 30 01:06:23.239002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 01:06:23.239002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 01:06:23.239002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 01:06:23.239002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 01:06:23.239002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 01:06:23.239002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 01:06:23.239002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 01:06:23.239002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 01:06:23.239002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXc4HENg-4Fl_BfZWJ8-xC7035VRPv4uGN1psnVVV-97znPR0oGESd-z83QWDJKyj9fw0vmpdDAV_z_CfzVEbKpZr4AMsZozMws9muKPW5-ad0KQpgx_YSqu9m6Tj-NurIDpCE8nDnQTjqjqvTtPtD7uvBU41NNyLswUtOAf651SwOHM Oct 30 01:06:23.239002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 01:06:23.239002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 01:06:23.239002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 01:06:23.239002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 01:06:23.239002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 01:06:23.239002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 01:06:23.239002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: fb6bef9b9f36443cbdd1a3d2e4058eca Oct 30 01:06:23.239002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-710775576 Oct 30 01:06:23.239002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 01:06:23.239002 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 01:06:23.240739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fb6bef9b9f36443cbdd1a3d2e4058eca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fb6bef9b9f36443cbdd1a3d2e4058eca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fb6bef9b9f36443cbdd1a3d2e4058eca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fb6bef9b9f36443cbdd1a3d2e4058eca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:06:23.240739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-VolumesSnapshotsTestJSON-710775576 Oct 30 01:06:23.240739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: fb6bef9b9f36443cbdd1a3d2e4058eca Oct 30 01:06:23.240739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-710775576 Oct 30 01:06:23.240739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-VolumesSnapshotsTestJSON-710775576-project Oct 30 01:06:23.240739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 01:06:23.240739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 01:06:23.240739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: e61e7c203eff4d6bb5b5b35de8bafd09 Oct 30 01:06:23.240739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-VolumesSnapshotsTestJSON-710775576-project Oct 30 01:06:23.240739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: Oct 30 01:06:23.240739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Snapshot 961e714e-319f-4655-a552-92a9a9b6d10b could not be found. Oct 30 01:06:23.240739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': '961e714e-319f-4655-a552-92a9a9b6d10b'} Oct 30 01:06:23.240739 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:06:23.242556 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:23.242556 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 30 01:06:23.242556 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 30 01:06:23.242556 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 30 01:06:23.242556 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 30 01:06:23.242556 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 30 01:06:23.242556 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 30 01:06:23.242556 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:06:23.242556 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:06:23.242556 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:06:23.242556 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:06:23.242556 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:06:23.242556 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:06:23.242556 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:06:23.242556 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:06:23.242556 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 961e714e-319f-4655-a552-92a9a9b6d10b could not be found. (HTTP 404) (Request-ID: req-aca324b0-ad76-43bf-98cb-7a2c85b91523) Oct 30 01:06:23.242556 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:23.242556 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:23.244005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:23.244005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:23.244005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 30 01:06:23.244005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 30 01:06:23.244005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 01:06:23.244005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 01:06:23.244005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 30 01:06:23.244005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 30 01:06:23.244005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 01:06:23.244005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 01:06:23.244005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 30 01:06:23.244005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 30 01:06:23.244005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 30 01:06:23.244005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 30 01:06:23.244005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 30 01:06:23.244005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 30 01:06:23.244005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:06:23.244005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:06:23.244005 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:06:23.245382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:06:23.245382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:06:23.245382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:06:23.245382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:06:23.245382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:06:23.245382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 961e714e-319f-4655-a552-92a9a9b6d10b could not be found. Oct 30 01:06:23.245382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:23.245382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:23.245382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:23.245382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:23.245382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:23.245382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:23.245382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:06:23.245382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:06:23.245382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:06:23.245382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:06:23.245382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:06:23.245382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:06:23.245382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 30 01:06:23.245382 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:06:23.246688 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 961e714e-319f-4655-a552-92a9a9b6d10b could not be found. Oct 30 01:06:23.246688 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:23.246688 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:23.246688 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:23.246688 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:23.246688 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:23.246688 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:23.246688 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:06:23.246688 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:06:23.246688 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 961e714e-319f-4655-a552-92a9a9b6d10b could not be found. Oct 30 01:06:23.246688 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:23.246688 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-83273d64-8494-4de2-b692-721f8fe8a301 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Returning 404 to user: Snapshot 961e714e-319f-4655-a552-92a9a9b6d10b could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:06:23.246688 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-83273d64-8494-4de2-b692-721f8fe8a301 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/961e714e-319f-4655-a552-92a9a9b6d10b" status: 404 len: 111 microversion: 2.1 time: 0.033850 Oct 30 01:06:23.247546 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 554/1128] 10.222.0.36 () {58 vars in 1251 bytes} [Sun Oct 30 01:06:23 2022] GET /compute/v2.1/os-snapshots/961e714e-319f-4655-a552-92a9a9b6d10b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:06:23.249843 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2619782a-3769-463e-bded-261a586d23ec tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Calling method '.version_select at 0x7faf792f0b80>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:23.311628 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2619782a-3769-463e-bded-261a586d23ec tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/b21828a7-9bed-413b-9ea4-1051ac55dccc" status: 202 len: 0 microversion: 2.1 time: 0.066229 Oct 30 01:06:23.312214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 575/1129] 10.222.0.36 () {58 vars in 1248 bytes} [Sun Oct 30 01:06:23 2022] DELETE /compute/v2.1/os-volumes/b21828a7-9bed-413b-9ea4-1051ac55dccc => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 30 01:06:23.320270 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-2eaa1c37-ed79-4393-9e5e-672c787e46dd tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Calling method '.version_select at 0x7faf75caf5e0>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:23.370174 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-2eaa1c37-ed79-4393-9e5e-672c787e46dd tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b21828a7-9bed-413b-9ea4-1051ac55dccc" status: 200 len: 345 microversion: 2.1 time: 0.053696 Oct 30 01:06:23.370720 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 555/1130] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Oct 30 01:06:23 2022] GET /compute/v2.1/os-volumes/b21828a7-9bed-413b-9ea4-1051ac55dccc => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:06:24.381787 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:24.382684 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=20 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:06:24.387186 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-09a92beb-b03e-4c06-978f-6fda2349275a tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Calling method '.version_select at 0x7faf793e9430>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:24.414941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-09a92beb-b03e-4c06-978f-6fda2349275a tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] HTTP exception thrown: Volume b21828a7-9bed-413b-9ea4-1051ac55dccc could not be found. Oct 30 01:06:24.416924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-09a92beb-b03e-4c06-978f-6fda2349275a tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Request method failure captured: Oct 30 01:06:24.416924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: GET /compute/v2.1/os-volumes/b21828a7-9bed-413b-9ea4-1051ac55dccc HTTP/1.1 Oct 30 01:06:24.416924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 01:06:24.416924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 01:06:24.416924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 01:06:24.416924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 01:06:24.416924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 01:06:24.416924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 01:06:24.416924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 01:06:24.416924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 01:06:24.416924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXc4HENg-4Fl_BfZWJ8-xC7035VRPv4uGN1psnVVV-97znPR0oGESd-z83QWDJKyj9fw0vmpdDAV_z_CfzVEbKpZr4AMsZozMws9muKPW5-ad0KQpgx_YSqu9m6Tj-NurIDpCE8nDnQTjqjqvTtPtD7uvBU41NNyLswUtOAf651SwOHM Oct 30 01:06:24.416924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 01:06:24.416924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 01:06:24.416924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 01:06:24.416924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 01:06:24.416924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 01:06:24.416924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 01:06:24.416924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: fb6bef9b9f36443cbdd1a3d2e4058eca Oct 30 01:06:24.416924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-710775576 Oct 30 01:06:24.416924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 01:06:24.416924 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 01:06:24.418598 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fb6bef9b9f36443cbdd1a3d2e4058eca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fb6bef9b9f36443cbdd1a3d2e4058eca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fb6bef9b9f36443cbdd1a3d2e4058eca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fb6bef9b9f36443cbdd1a3d2e4058eca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:06:24.418598 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-VolumesSnapshotsTestJSON-710775576 Oct 30 01:06:24.418598 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: fb6bef9b9f36443cbdd1a3d2e4058eca Oct 30 01:06:24.418598 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-710775576 Oct 30 01:06:24.418598 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-VolumesSnapshotsTestJSON-710775576-project Oct 30 01:06:24.418598 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 01:06:24.418598 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 01:06:24.418598 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: e61e7c203eff4d6bb5b5b35de8bafd09 Oct 30 01:06:24.418598 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-VolumesSnapshotsTestJSON-710775576-project Oct 30 01:06:24.418598 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: Oct 30 01:06:24.418598 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Volume b21828a7-9bed-413b-9ea4-1051ac55dccc could not be found. Oct 30 01:06:24.418598 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': 'b21828a7-9bed-413b-9ea4-1051ac55dccc'} Oct 30 01:06:24.418598 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:06:24.419789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:24.419789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:06:24.419789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:06:24.419789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:06:24.419789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:06:24.419789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:06:24.419789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:06:24.419789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:06:24.419789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:06:24.419789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:06:24.419789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:06:24.419789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:06:24.419789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:06:24.419789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:06:24.419789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:06:24.419789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b21828a7-9bed-413b-9ea4-1051ac55dccc could not be found. (HTTP 404) (Request-ID: req-7d99af53-a70b-413e-a00f-2d3e5c53ba0a) Oct 30 01:06:24.419789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:24.419789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:24.419789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:24.422012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:24.422012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 30 01:06:24.422012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 30 01:06:24.422012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 01:06:24.422012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 01:06:24.422012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 01:06:24.422012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 01:06:24.422012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 01:06:24.422012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 01:06:24.422012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:06:24.422012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:06:24.422012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:06:24.422012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:06:24.422012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:06:24.422012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:06:24.422012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:06:24.422012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:06:24.422012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:06:24.422012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:06:24.423949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:06:24.423949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:06:24.423949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:06:24.423949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:06:24.423949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b21828a7-9bed-413b-9ea4-1051ac55dccc could not be found. Oct 30 01:06:24.423949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:24.423949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:24.423949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:24.423949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:24.423949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:24.423949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:24.423949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:06:24.423949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:06:24.423949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:06:24.423949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:06:24.423949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:06:24.423949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:06:24.423949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 30 01:06:24.423949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:06:24.425939 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b21828a7-9bed-413b-9ea4-1051ac55dccc could not be found. Oct 30 01:06:24.425939 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:24.425939 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:24.425939 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:24.425939 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:24.425939 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:24.425939 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:24.425939 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:06:24.425939 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:06:24.425939 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b21828a7-9bed-413b-9ea4-1051ac55dccc could not be found. Oct 30 01:06:24.425939 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:24.425939 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-09a92beb-b03e-4c06-978f-6fda2349275a tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Returning 404 to user: Volume b21828a7-9bed-413b-9ea4-1051ac55dccc could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:06:24.425939 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-09a92beb-b03e-4c06-978f-6fda2349275a tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b21828a7-9bed-413b-9ea4-1051ac55dccc" status: 404 len: 109 microversion: 2.1 time: 0.037401 Oct 30 01:06:24.425939 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 576/1131] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Oct 30 01:06:24 2022] GET /compute/v2.1/os-volumes/b21828a7-9bed-413b-9ea4-1051ac55dccc => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:06:24.434527 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c20c6000-42a8-4e8e-afd3-c6018f4e0ff5 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Calling method '.version_select at 0x7faf75bdcf70>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:24.462305 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-c20c6000-42a8-4e8e-afd3-c6018f4e0ff5 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] HTTP exception thrown: Volume b21828a7-9bed-413b-9ea4-1051ac55dccc could not be found. Oct 30 01:06:24.464319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c20c6000-42a8-4e8e-afd3-c6018f4e0ff5 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Request method failure captured: Oct 30 01:06:24.464319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: DELETE /compute/v2.1/os-volumes/b21828a7-9bed-413b-9ea4-1051ac55dccc HTTP/1.1 Oct 30 01:06:24.464319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 01:06:24.464319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 01:06:24.464319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 01:06:24.464319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 01:06:24.464319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 01:06:24.464319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 01:06:24.464319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 01:06:24.464319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 01:06:24.464319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXc4HENg-4Fl_BfZWJ8-xC7035VRPv4uGN1psnVVV-97znPR0oGESd-z83QWDJKyj9fw0vmpdDAV_z_CfzVEbKpZr4AMsZozMws9muKPW5-ad0KQpgx_YSqu9m6Tj-NurIDpCE8nDnQTjqjqvTtPtD7uvBU41NNyLswUtOAf651SwOHM Oct 30 01:06:24.464319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 01:06:24.464319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 01:06:24.464319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 01:06:24.464319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 01:06:24.464319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 01:06:24.464319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 01:06:24.464319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: fb6bef9b9f36443cbdd1a3d2e4058eca Oct 30 01:06:24.464319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-710775576 Oct 30 01:06:24.464319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 01:06:24.464319 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 01:06:24.465928 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fb6bef9b9f36443cbdd1a3d2e4058eca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fb6bef9b9f36443cbdd1a3d2e4058eca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fb6bef9b9f36443cbdd1a3d2e4058eca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fb6bef9b9f36443cbdd1a3d2e4058eca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:06:24.465928 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-VolumesSnapshotsTestJSON-710775576 Oct 30 01:06:24.465928 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: fb6bef9b9f36443cbdd1a3d2e4058eca Oct 30 01:06:24.465928 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-710775576 Oct 30 01:06:24.465928 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-VolumesSnapshotsTestJSON-710775576-project Oct 30 01:06:24.465928 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 01:06:24.465928 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 01:06:24.465928 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: e61e7c203eff4d6bb5b5b35de8bafd09 Oct 30 01:06:24.465928 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-VolumesSnapshotsTestJSON-710775576-project Oct 30 01:06:24.465928 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: Oct 30 01:06:24.465928 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Volume b21828a7-9bed-413b-9ea4-1051ac55dccc could not be found. Oct 30 01:06:24.465928 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': 'b21828a7-9bed-413b-9ea4-1051ac55dccc'} Oct 30 01:06:24.465928 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:06:24.466869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:24.466869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:06:24.466869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:06:24.466869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 30 01:06:24.466869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 30 01:06:24.466869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 30 01:06:24.466869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 30 01:06:24.466869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 30 01:06:24.466869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 30 01:06:24.466869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 30 01:06:24.466869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 30 01:06:24.466869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:06:24.466869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:06:24.466869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:06:24.466869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:06:24.466869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b21828a7-9bed-413b-9ea4-1051ac55dccc could not be found. (HTTP 404) (Request-ID: req-f43acdef-75b2-466e-b11f-ab54e891efe5) Oct 30 01:06:24.466869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:24.466869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:24.466869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:24.468780 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:24.468780 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 30 01:06:24.468780 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 30 01:06:24.468780 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 01:06:24.468780 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 01:06:24.468780 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 01:06:24.468780 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 01:06:24.468780 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 01:06:24.468780 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 01:06:24.468780 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:06:24.468780 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:06:24.468780 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 30 01:06:24.468780 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 30 01:06:24.468780 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 30 01:06:24.468780 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 30 01:06:24.468780 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 30 01:06:24.468780 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 30 01:06:24.468780 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 30 01:06:24.468780 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 30 01:06:24.470001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:06:24.470001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:06:24.470001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:06:24.470001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:06:24.470001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b21828a7-9bed-413b-9ea4-1051ac55dccc could not be found. Oct 30 01:06:24.470001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:24.470001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:24.470001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:24.470001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:24.470001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:24.470001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:24.470001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:06:24.470001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:06:24.470001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:06:24.470001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:06:24.470001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:06:24.470001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:06:24.470001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 30 01:06:24.470001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:06:24.472125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b21828a7-9bed-413b-9ea4-1051ac55dccc could not be found. Oct 30 01:06:24.472125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:24.472125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:24.472125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:24.472125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:24.472125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:24.472125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:24.472125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:06:24.472125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:06:24.472125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b21828a7-9bed-413b-9ea4-1051ac55dccc could not be found. Oct 30 01:06:24.472125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:06:24.472125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c20c6000-42a8-4e8e-afd3-c6018f4e0ff5 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Returning 404 to user: Volume b21828a7-9bed-413b-9ea4-1051ac55dccc could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:06:24.472125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c20c6000-42a8-4e8e-afd3-c6018f4e0ff5 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/b21828a7-9bed-413b-9ea4-1051ac55dccc" status: 404 len: 109 microversion: 2.1 time: 0.035577 Oct 30 01:06:24.472125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 556/1132] 10.222.0.36 () {58 vars in 1248 bytes} [Sun Oct 30 01:06:24 2022] DELETE /compute/v2.1/os-volumes/b21828a7-9bed-413b-9ea4-1051ac55dccc => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:06:24.475016 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-1565015b-985c-4a21-843e-a70edc388a71 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Calling method '.version_select at 0x7faf792934c0>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:06:24.675025 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-1565015b-985c-4a21-843e-a70edc388a71 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] HTTP exception thrown: Volume b21828a7-9bed-413b-9ea4-1051ac55dccc could not be found. Oct 30 01:06:24.677020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-1565015b-985c-4a21-843e-a70edc388a71 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Request method failure captured: Oct 30 01:06:24.677020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: GET /compute/v2.1/os-volumes/b21828a7-9bed-413b-9ea4-1051ac55dccc HTTP/1.1 Oct 30 01:06:24.677020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 01:06:24.677020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 01:06:24.677020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 01:06:24.677020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 01:06:24.677020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 01:06:24.677020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 01:06:24.677020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 01:06:24.677020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 01:06:24.677020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXc4HENg-4Fl_BfZWJ8-xC7035VRPv4uGN1psnVVV-97znPR0oGESd-z83QWDJKyj9fw0vmpdDAV_z_CfzVEbKpZr4AMsZozMws9muKPW5-ad0KQpgx_YSqu9m6Tj-NurIDpCE8nDnQTjqjqvTtPtD7uvBU41NNyLswUtOAf651SwOHM Oct 30 01:06:24.677020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 01:06:24.677020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 01:06:24.677020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 01:06:24.677020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 01:06:24.677020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 01:06:24.677020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 01:06:24.677020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: fb6bef9b9f36443cbdd1a3d2e4058eca Oct 30 01:06:24.677020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-710775576 Oct 30 01:06:24.677020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 01:06:24.677020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 01:06:24.678738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fb6bef9b9f36443cbdd1a3d2e4058eca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fb6bef9b9f36443cbdd1a3d2e4058eca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fb6bef9b9f36443cbdd1a3d2e4058eca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fb6bef9b9f36443cbdd1a3d2e4058eca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:06:24.678738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-VolumesSnapshotsTestJSON-710775576 Oct 30 01:06:24.678738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: fb6bef9b9f36443cbdd1a3d2e4058eca Oct 30 01:06:24.678738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-710775576 Oct 30 01:06:24.678738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-VolumesSnapshotsTestJSON-710775576-project Oct 30 01:06:24.678738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 01:06:24.678738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 01:06:24.678738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: e61e7c203eff4d6bb5b5b35de8bafd09 Oct 30 01:06:24.678738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-VolumesSnapshotsTestJSON-710775576-project Oct 30 01:06:24.678738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: Oct 30 01:06:24.678738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Volume b21828a7-9bed-413b-9ea4-1051ac55dccc could not be found. Oct 30 01:06:24.678738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': 'b21828a7-9bed-413b-9ea4-1051ac55dccc'} Oct 30 01:06:24.678738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:06:24.679659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:24.679659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:06:24.679659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:06:24.679659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:06:24.679659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:06:24.679659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:06:24.679659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:06:24.679659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:06:24.679659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:06:24.679659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:06:24.679659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:06:24.679659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:06:24.679659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:06:24.679659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:06:24.679659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:06:24.679659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b21828a7-9bed-413b-9ea4-1051ac55dccc could not be found. (HTTP 404) (Request-ID: req-3258dee5-e573-43d2-994f-2ee1a5154087) Oct 30 01:06:24.679659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:24.679659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:24.679659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:24.680941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:24.680941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 30 01:06:24.680941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 30 01:06:24.680941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 30 01:06:24.680941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 30 01:06:24.680941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 30 01:06:24.680941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 30 01:06:24.680941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 30 01:06:24.680941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 30 01:06:24.680941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 30 01:06:24.680941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 30 01:06:24.680941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 30 01:06:24.680941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 30 01:06:24.680941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 30 01:06:24.680941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 30 01:06:24.680941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 30 01:06:24.680941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 30 01:06:24.680941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 30 01:06:24.680941 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 30 01:06:24.682250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 30 01:06:24.682250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 30 01:06:24.682250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 30 01:06:24.682250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 30 01:06:24.682250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b21828a7-9bed-413b-9ea4-1051ac55dccc could not be found. Oct 30 01:06:24.682250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:24.682250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:24.682250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:24.682250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:24.682250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:24.682250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:24.682250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:06:24.682250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:06:24.682250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 30 01:06:24.682250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 30 01:06:24.682250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:06:24.682250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:06:24.682250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 30 01:06:24.682250 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:06:24.683725 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b21828a7-9bed-413b-9ea4-1051ac55dccc could not be found. Oct 30 01:06:24.683725 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:24.683725 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:06:24.683725 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:24.683725 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:06:24.683725 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:06:24.683725 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:06:24.683725 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:06:24.683725 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:06:24.683725 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b21828a7-9bed-413b-9ea4-1051ac55dccc could not be found. Oct 30 01:06:24.683725 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:06:24.683725 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-1565015b-985c-4a21-843e-a70edc388a71 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] Returning 404 to user: Volume b21828a7-9bed-413b-9ea4-1051ac55dccc could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:06:24.683725 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-1565015b-985c-4a21-843e-a70edc388a71 tempest-VolumesSnapshotsTestJSON-710775576 tempest-VolumesSnapshotsTestJSON-710775576-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/b21828a7-9bed-413b-9ea4-1051ac55dccc" status: 404 len: 109 microversion: 2.1 time: 0.207174 Oct 30 01:06:24.683725 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 577/1133] 10.222.0.36 () {58 vars in 1245 bytes} [Sun Oct 30 01:06:24 2022] GET /compute/v2.1/os-volumes/b21828a7-9bed-413b-9ea4-1051ac55dccc => generated 109 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:07:06.686917 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:07:06.688769 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=98 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:07:06.692823 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e6806eac-b27d-491f-8dfe-228a6b91c0af tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Action: 'create', calling method: .version_select at 0x7faf75b084c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-278444165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQ7PWbpKdmo5E0WiWK88EbVqNeUnZ1ZxFWhlpTrVsk0PjqTShtJVtvkHdNM3fYkb/ctujehSWY0enmtEYT1BzOk0lgqG0fPdiCYR1K3D7wkpqW5FbdnSe4a5P8v1nKpJA=="}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:07:06.710395 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-e6806eac-b27d-491f-8dfe-228a6b91c0af tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Getting quotas for project 4012d80a074641cc80074df4f602d9f0. Resources: {'key_pairs'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:07:06.714222 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-e6806eac-b27d-491f-8dfe-228a6b91c0af tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Getting quotas for user 578ca2679aa44174b912eb70339373cb and project 4012d80a074641cc80074df4f602d9f0. Resources: {'key_pairs'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:07:06.736175 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e6806eac-b27d-491f-8dfe-228a6b91c0af tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.050653 Oct 30 01:07:06.736763 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 557/1134] 10.222.0.36 () {60 vars in 1159 bytes} [Sun Oct 30 01:07:06 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:07:06.787744 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7b270c88-932c-4020-847c-d71f10be4091 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-920078695", "imageRef": "d6a2b9d0-3b08-42d1-ade3-7fe197034d08", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-278444165", "networks": [{"uuid": "047d2f92-5490-45ee-becd-66ecc2249e6e"}]}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:07:06.839668 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.network.neutron [None req-7b270c88-932c-4020-847c-d71f10be4091 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] validate_networks() for [('047d2f92-5490-45ee-becd-66ecc2249e6e', None, None, None, None, None)] {{(pid=125554) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:07:07.217766 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-7b270c88-932c-4020-847c-d71f10be4091 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Flavor limits 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:07:07.218179 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-7b270c88-932c-4020-847c-d71f10be4091 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Image limits 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:07:07.219338 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-7b270c88-932c-4020-847c-d71f10be4091 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Flavor pref 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:07:07.219719 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-7b270c88-932c-4020-847c-d71f10be4091 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Image pref 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:07:07.220183 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-7b270c88-932c-4020-847c-d71f10be4091 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:07:07.228906 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7b270c88-932c-4020-847c-d71f10be4091 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:07.229371 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7b270c88-932c-4020-847c-d71f10be4091 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:07.229792 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7b270c88-932c-4020-847c-d71f10be4091 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:07.230514 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7b270c88-932c-4020-847c-d71f10be4091 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:07.230949 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7b270c88-932c-4020-847c-d71f10be4091 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:07.231358 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7b270c88-932c-4020-847c-d71f10be4091 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:07.247792 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-7b270c88-932c-4020-847c-d71f10be4091 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Getting quotas for project 4012d80a074641cc80074df4f602d9f0. Resources: {'instances', 'cores', 'ram'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:07:07.251710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-7b270c88-932c-4020-847c-d71f10be4091 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Getting quotas for user 578ca2679aa44174b912eb70339373cb and project 4012d80a074641cc80074df4f602d9f0. Resources: {'instances', 'cores', 'ram'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:07:07.262599 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-7b270c88-932c-4020-847c-d71f10be4091 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Going to run 1 instances... {{(pid=125554) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:07:07.264869 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-7b270c88-932c-4020-847c-d71f10be4091 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d6a2b9d0-3b08-42d1-ade3-7fe197034d08',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125554) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:07:07.309132 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7b270c88-932c-4020-847c-d71f10be4091 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [67e03c1e-2784-4c3e-a453-ebdddbb0009e] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 30 01:07:08.317326 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO oslo.messaging._drivers.impl_rabbit [None req-7b270c88-932c-4020-847c-d71f10be4091 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [67e03c1e-2784-4c3e-a453-ebdddbb0009e] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 39232. Oct 30 01:07:08.321550 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7b270c88-932c-4020-847c-d71f10be4091 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.538476 Oct 30 01:07:08.322196 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 578/1135] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Oct 30 01:07:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:07:08.334175 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-3819fff7-61e5-47d3-b015-520e35872715 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:08.334939 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-3819fff7-61e5-47d3-b015-520e35872715 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:08.395787 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-3819fff7-61e5-47d3-b015-520e35872715 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:08.402844 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-3819fff7-61e5-47d3-b015-520e35872715 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1257 microversion: 2.1 time: 0.072944 Oct 30 01:07:08.403385 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 558/1136] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:08 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1257 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:09.426288 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-bf93cede-fbef-4f6e-ae0a-5aca1c2be913 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:09.426907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-bf93cede-fbef-4f6e-ae0a-5aca1c2be913 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:09.433591 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bf93cede-fbef-4f6e-ae0a-5aca1c2be913 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:09.434078 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bf93cede-fbef-4f6e-ae0a-5aca1c2be913 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:09.434512 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bf93cede-fbef-4f6e-ae0a-5aca1c2be913 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:09.435204 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bf93cede-fbef-4f6e-ae0a-5aca1c2be913 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:09.435861 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bf93cede-fbef-4f6e-ae0a-5aca1c2be913 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:09.436322 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bf93cede-fbef-4f6e-ae0a-5aca1c2be913 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:09.507930 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-bf93cede-fbef-4f6e-ae0a-5aca1c2be913 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:09.516561 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-bf93cede-fbef-4f6e-ae0a-5aca1c2be913 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1317 microversion: 2.1 time: 0.094006 Oct 30 01:07:09.517616 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 579/1137] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:09 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1317 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:10.540698 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-8a3b9f39-d51a-474f-b29b-170d7220483d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:10.541439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-8a3b9f39-d51a-474f-b29b-170d7220483d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:10.548776 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a3b9f39-d51a-474f-b29b-170d7220483d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:10.549407 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a3b9f39-d51a-474f-b29b-170d7220483d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:10.549734 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a3b9f39-d51a-474f-b29b-170d7220483d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:10.550421 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a3b9f39-d51a-474f-b29b-170d7220483d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:10.550872 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a3b9f39-d51a-474f-b29b-170d7220483d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:10.551293 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8a3b9f39-d51a-474f-b29b-170d7220483d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:10.689657 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8a3b9f39-d51a-474f-b29b-170d7220483d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:10.699404 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-8a3b9f39-d51a-474f-b29b-170d7220483d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1357 microversion: 2.1 time: 0.162361 Oct 30 01:07:10.699972 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 559/1138] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:10 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:11.724242 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-a23b30c9-3cdf-424b-a24a-3919124d9875 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:11.724983 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-a23b30c9-3cdf-424b-a24a-3919124d9875 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:11.731714 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a23b30c9-3cdf-424b-a24a-3919124d9875 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:11.732310 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a23b30c9-3cdf-424b-a24a-3919124d9875 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:11.732856 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a23b30c9-3cdf-424b-a24a-3919124d9875 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:11.733633 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a23b30c9-3cdf-424b-a24a-3919124d9875 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:11.734799 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a23b30c9-3cdf-424b-a24a-3919124d9875 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:11.735748 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a23b30c9-3cdf-424b-a24a-3919124d9875 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:11.876061 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-a23b30c9-3cdf-424b-a24a-3919124d9875 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:11.884038 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-a23b30c9-3cdf-424b-a24a-3919124d9875 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1357 microversion: 2.1 time: 0.163708 Oct 30 01:07:11.884624 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 580/1139] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:11 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:07:12.908450 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-8432f892-d29d-4b91-8a50-e6ffe18ecf2b tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:12.909054 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-8432f892-d29d-4b91-8a50-e6ffe18ecf2b tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:12.916254 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8432f892-d29d-4b91-8a50-e6ffe18ecf2b tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:12.917067 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8432f892-d29d-4b91-8a50-e6ffe18ecf2b tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:12.917744 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8432f892-d29d-4b91-8a50-e6ffe18ecf2b tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:12.918696 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8432f892-d29d-4b91-8a50-e6ffe18ecf2b tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:12.919212 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8432f892-d29d-4b91-8a50-e6ffe18ecf2b tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:12.919722 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-8432f892-d29d-4b91-8a50-e6ffe18ecf2b tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:13.052841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-8432f892-d29d-4b91-8a50-e6ffe18ecf2b tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:13.060670 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-8432f892-d29d-4b91-8a50-e6ffe18ecf2b tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1357 microversion: 2.1 time: 0.156141 Oct 30 01:07:13.061237 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 560/1140] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:12 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:14.083950 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-164b8eef-77d1-40e9-899e-0e07537fdd5e tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:14.084782 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-164b8eef-77d1-40e9-899e-0e07537fdd5e tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:14.099510 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-164b8eef-77d1-40e9-899e-0e07537fdd5e tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:14.100160 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-164b8eef-77d1-40e9-899e-0e07537fdd5e tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:14.100645 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-164b8eef-77d1-40e9-899e-0e07537fdd5e tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:14.101452 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-164b8eef-77d1-40e9-899e-0e07537fdd5e tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:14.101918 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-164b8eef-77d1-40e9-899e-0e07537fdd5e tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:14.102344 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-164b8eef-77d1-40e9-899e-0e07537fdd5e tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:14.239335 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-164b8eef-77d1-40e9-899e-0e07537fdd5e tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:14.246176 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-164b8eef-77d1-40e9-899e-0e07537fdd5e tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1357 microversion: 2.1 time: 0.166180 Oct 30 01:07:14.247221 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 581/1141] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:14 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:15.271778 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-db9de749-f5da-41b3-b9d4-26bd1c45d007 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:15.272501 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-db9de749-f5da-41b3-b9d4-26bd1c45d007 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:15.281072 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-db9de749-f5da-41b3-b9d4-26bd1c45d007 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:15.281567 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-db9de749-f5da-41b3-b9d4-26bd1c45d007 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:15.282471 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-db9de749-f5da-41b3-b9d4-26bd1c45d007 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:15.282911 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-db9de749-f5da-41b3-b9d4-26bd1c45d007 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:15.283372 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-db9de749-f5da-41b3-b9d4-26bd1c45d007 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:15.283802 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-db9de749-f5da-41b3-b9d4-26bd1c45d007 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:15.516062 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-db9de749-f5da-41b3-b9d4-26bd1c45d007 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:15.525912 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-db9de749-f5da-41b3-b9d4-26bd1c45d007 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1357 microversion: 2.1 time: 0.258943 Oct 30 01:07:15.526598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 561/1142] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:15 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1357 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:16.555095 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c9600f23-645c-4267-9292-c3b45625d498 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:16.556693 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c9600f23-645c-4267-9292-c3b45625d498 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:16.564193 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c9600f23-645c-4267-9292-c3b45625d498 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:16.565045 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c9600f23-645c-4267-9292-c3b45625d498 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:16.565716 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c9600f23-645c-4267-9292-c3b45625d498 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:16.566996 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c9600f23-645c-4267-9292-c3b45625d498 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:16.567519 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c9600f23-645c-4267-9292-c3b45625d498 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:16.568016 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c9600f23-645c-4267-9292-c3b45625d498 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:16.705368 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c9600f23-645c-4267-9292-c3b45625d498 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:16.713829 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c9600f23-645c-4267-9292-c3b45625d498 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1357 microversion: 2.1 time: 0.162699 Oct 30 01:07:16.714619 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 582/1143] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:16 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:17.739388 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-53dd7ea0-9705-4416-9677-ea18b42ce07c tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:17.740720 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-53dd7ea0-9705-4416-9677-ea18b42ce07c tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:17.748305 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-53dd7ea0-9705-4416-9677-ea18b42ce07c tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:17.748903 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-53dd7ea0-9705-4416-9677-ea18b42ce07c tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:17.749338 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-53dd7ea0-9705-4416-9677-ea18b42ce07c tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:17.750050 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-53dd7ea0-9705-4416-9677-ea18b42ce07c tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:17.751066 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-53dd7ea0-9705-4416-9677-ea18b42ce07c tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:17.751520 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-53dd7ea0-9705-4416-9677-ea18b42ce07c tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:17.894820 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-53dd7ea0-9705-4416-9677-ea18b42ce07c tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:17.902905 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-53dd7ea0-9705-4416-9677-ea18b42ce07c tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1357 microversion: 2.1 time: 0.168730 Oct 30 01:07:17.903664 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 562/1144] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:17 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:18.927023 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-224b3fc1-57da-42b8-ad05-8ec62e25ff8f tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:18.927638 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-224b3fc1-57da-42b8-ad05-8ec62e25ff8f tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:18.929986 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=2 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:07:18.930774 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=6 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:07:18.938915 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-224b3fc1-57da-42b8-ad05-8ec62e25ff8f tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:18.939220 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-224b3fc1-57da-42b8-ad05-8ec62e25ff8f tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:18.939521 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-224b3fc1-57da-42b8-ad05-8ec62e25ff8f tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:18.940251 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-224b3fc1-57da-42b8-ad05-8ec62e25ff8f tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:18.940694 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-224b3fc1-57da-42b8-ad05-8ec62e25ff8f tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:18.941109 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-224b3fc1-57da-42b8-ad05-8ec62e25ff8f tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:19.071662 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-224b3fc1-57da-42b8-ad05-8ec62e25ff8f tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:19.080267 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-224b3fc1-57da-42b8-ad05-8ec62e25ff8f tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1357 microversion: 2.1 time: 0.157677 Oct 30 01:07:19.080869 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 583/1145] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:18 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:20.103791 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-b22e61bd-d97f-4069-bbb8-353eb2206591 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:20.104447 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-b22e61bd-d97f-4069-bbb8-353eb2206591 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:20.106103 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=6 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:07:20.112598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b22e61bd-d97f-4069-bbb8-353eb2206591 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:20.113074 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b22e61bd-d97f-4069-bbb8-353eb2206591 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:20.113503 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b22e61bd-d97f-4069-bbb8-353eb2206591 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:20.114192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b22e61bd-d97f-4069-bbb8-353eb2206591 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:20.114639 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b22e61bd-d97f-4069-bbb8-353eb2206591 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:20.115093 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b22e61bd-d97f-4069-bbb8-353eb2206591 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:20.243755 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-b22e61bd-d97f-4069-bbb8-353eb2206591 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:20.251582 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-b22e61bd-d97f-4069-bbb8-353eb2206591 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1357 microversion: 2.1 time: 0.151960 Oct 30 01:07:20.252152 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 563/1146] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:20 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:21.273738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-07a9dc80-5677-444a-9dd0-f4f995fa013d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:21.274323 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-07a9dc80-5677-444a-9dd0-f4f995fa013d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:21.280723 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-07a9dc80-5677-444a-9dd0-f4f995fa013d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:21.281351 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-07a9dc80-5677-444a-9dd0-f4f995fa013d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:21.281784 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-07a9dc80-5677-444a-9dd0-f4f995fa013d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:21.282583 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-07a9dc80-5677-444a-9dd0-f4f995fa013d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:21.283041 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-07a9dc80-5677-444a-9dd0-f4f995fa013d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:21.283459 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-07a9dc80-5677-444a-9dd0-f4f995fa013d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:21.421381 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-07a9dc80-5677-444a-9dd0-f4f995fa013d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:21.429970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-07a9dc80-5677-444a-9dd0-f4f995fa013d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1357 microversion: 2.1 time: 0.160057 Oct 30 01:07:21.430532 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 584/1147] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:21 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:21.917555 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-ff87e065-c912-4ab5-8611-6eeebcf8d43d req-e5f29a24-686a-4cfb-abd3-38257214352d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9", "tag": "2f2d3a7d-dcac-4dcb-a220-b51bd1719f54"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:07:21.929201 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-ff87e065-c912-4ab5-8611-6eeebcf8d43d req-e5f29a24-686a-4cfb-abd3-38257214352d service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:21.929689 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-ff87e065-c912-4ab5-8611-6eeebcf8d43d req-e5f29a24-686a-4cfb-abd3-38257214352d service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:21.930125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-ff87e065-c912-4ab5-8611-6eeebcf8d43d req-e5f29a24-686a-4cfb-abd3-38257214352d service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:21.941925 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-ff87e065-c912-4ab5-8611-6eeebcf8d43d req-e5f29a24-686a-4cfb-abd3-38257214352d service nova] Creating event network-changed:2f2d3a7d-dcac-4dcb-a220-b51bd1719f54 for instance 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 on hv-cinder-86149 Oct 30 01:07:21.947374 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-ff87e065-c912-4ab5-8611-6eeebcf8d43d req-e5f29a24-686a-4cfb-abd3-38257214352d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034748 Oct 30 01:07:21.947967 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 564/1148] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:07:22.454447 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c87ad2a0-65d8-48b7-b954-6a9186841228 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:22.454984 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c87ad2a0-65d8-48b7-b954-6a9186841228 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:22.461306 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c87ad2a0-65d8-48b7-b954-6a9186841228 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:22.461777 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c87ad2a0-65d8-48b7-b954-6a9186841228 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:22.462206 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c87ad2a0-65d8-48b7-b954-6a9186841228 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:22.462883 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c87ad2a0-65d8-48b7-b954-6a9186841228 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:22.463410 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c87ad2a0-65d8-48b7-b954-6a9186841228 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:22.463822 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c87ad2a0-65d8-48b7-b954-6a9186841228 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:22.593887 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c87ad2a0-65d8-48b7-b954-6a9186841228 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:22.601509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c87ad2a0-65d8-48b7-b954-6a9186841228 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1357 microversion: 2.1 time: 0.152133 Oct 30 01:07:22.602068 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 585/1149] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:22 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:23.624877 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-42a790e6-70bd-433e-99e0-23408f9fbfbf tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:23.625850 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-42a790e6-70bd-433e-99e0-23408f9fbfbf tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:23.632241 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-42a790e6-70bd-433e-99e0-23408f9fbfbf tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:23.632717 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-42a790e6-70bd-433e-99e0-23408f9fbfbf tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:23.633145 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-42a790e6-70bd-433e-99e0-23408f9fbfbf tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:23.633832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-42a790e6-70bd-433e-99e0-23408f9fbfbf tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:23.634276 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-42a790e6-70bd-433e-99e0-23408f9fbfbf tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:23.634692 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-42a790e6-70bd-433e-99e0-23408f9fbfbf tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:23.763469 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-42a790e6-70bd-433e-99e0-23408f9fbfbf tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:23.771688 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-42a790e6-70bd-433e-99e0-23408f9fbfbf tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1357 microversion: 2.1 time: 0.151026 Oct 30 01:07:23.772268 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 565/1150] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:23 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:24.794783 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-55154e45-6252-44fe-adef-68b417f241f0 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:24.795376 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-55154e45-6252-44fe-adef-68b417f241f0 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:24.802733 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55154e45-6252-44fe-adef-68b417f241f0 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:24.803214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55154e45-6252-44fe-adef-68b417f241f0 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:24.803650 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55154e45-6252-44fe-adef-68b417f241f0 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:24.804589 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55154e45-6252-44fe-adef-68b417f241f0 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:24.805045 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55154e45-6252-44fe-adef-68b417f241f0 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:24.805468 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55154e45-6252-44fe-adef-68b417f241f0 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:24.941473 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-55154e45-6252-44fe-adef-68b417f241f0 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:24.949386 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-55154e45-6252-44fe-adef-68b417f241f0 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1357 microversion: 2.1 time: 0.158453 Oct 30 01:07:24.949937 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 586/1151] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:24 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:25.972419 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-7e567de3-e0c9-459b-9cae-342ace7b46fe tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:25.973107 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-7e567de3-e0c9-459b-9cae-342ace7b46fe tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:25.979616 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7e567de3-e0c9-459b-9cae-342ace7b46fe tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:25.980105 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7e567de3-e0c9-459b-9cae-342ace7b46fe tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:25.980565 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7e567de3-e0c9-459b-9cae-342ace7b46fe tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:25.981256 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7e567de3-e0c9-459b-9cae-342ace7b46fe tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:25.981708 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7e567de3-e0c9-459b-9cae-342ace7b46fe tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:25.982140 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-7e567de3-e0c9-459b-9cae-342ace7b46fe tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:26.112941 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-7e567de3-e0c9-459b-9cae-342ace7b46fe tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:26.120703 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-7e567de3-e0c9-459b-9cae-342ace7b46fe tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1357 microversion: 2.1 time: 0.152287 Oct 30 01:07:26.121269 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 566/1152] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:25 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:27.146239 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d79e9101-279c-4b4b-bd6c-661788a6b5dd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:27.147504 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-d79e9101-279c-4b4b-bd6c-661788a6b5dd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:27.153887 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d79e9101-279c-4b4b-bd6c-661788a6b5dd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:27.154360 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d79e9101-279c-4b4b-bd6c-661788a6b5dd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:27.154789 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d79e9101-279c-4b4b-bd6c-661788a6b5dd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:27.155475 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d79e9101-279c-4b4b-bd6c-661788a6b5dd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:27.155961 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d79e9101-279c-4b4b-bd6c-661788a6b5dd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:27.156414 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d79e9101-279c-4b4b-bd6c-661788a6b5dd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:27.284245 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-d79e9101-279c-4b4b-bd6c-661788a6b5dd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:27.292050 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-d79e9101-279c-4b4b-bd6c-661788a6b5dd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1357 microversion: 2.1 time: 0.151824 Oct 30 01:07:27.292638 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 587/1153] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:27 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:28.314865 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-81ce6085-e1f2-456a-a8af-f3e34db8f490 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:28.315472 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-81ce6085-e1f2-456a-a8af-f3e34db8f490 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:28.322455 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-81ce6085-e1f2-456a-a8af-f3e34db8f490 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:28.322935 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-81ce6085-e1f2-456a-a8af-f3e34db8f490 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:28.323364 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-81ce6085-e1f2-456a-a8af-f3e34db8f490 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:28.324043 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-81ce6085-e1f2-456a-a8af-f3e34db8f490 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:28.324520 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-81ce6085-e1f2-456a-a8af-f3e34db8f490 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:28.324936 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-81ce6085-e1f2-456a-a8af-f3e34db8f490 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:28.450952 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-81ce6085-e1f2-456a-a8af-f3e34db8f490 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:28.459428 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-81ce6085-e1f2-456a-a8af-f3e34db8f490 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1357 microversion: 2.1 time: 0.148574 Oct 30 01:07:28.459982 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 567/1154] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:28 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:29.131422 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-9ef8bba8-6e64-44b2-a203-ca07bde13f24 req-53e1b402-45e2-4380-989f-293cfc347d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9", "name": "network-vif-plugged", "status": "completed", "tag": "2f2d3a7d-dcac-4dcb-a220-b51bd1719f54"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:07:29.141680 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-9ef8bba8-6e64-44b2-a203-ca07bde13f24 req-53e1b402-45e2-4380-989f-293cfc347d73 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:29.142147 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-9ef8bba8-6e64-44b2-a203-ca07bde13f24 req-53e1b402-45e2-4380-989f-293cfc347d73 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:29.142568 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-9ef8bba8-6e64-44b2-a203-ca07bde13f24 req-53e1b402-45e2-4380-989f-293cfc347d73 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:29.153835 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-9ef8bba8-6e64-44b2-a203-ca07bde13f24 req-53e1b402-45e2-4380-989f-293cfc347d73 service nova] Creating event network-vif-plugged:2f2d3a7d-dcac-4dcb-a220-b51bd1719f54 for instance 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 on hv-cinder-86149 Oct 30 01:07:29.159249 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-9ef8bba8-6e64-44b2-a203-ca07bde13f24 req-53e1b402-45e2-4380-989f-293cfc347d73 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031541 Oct 30 01:07:29.159836 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 588/1155] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:07:29.482708 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-4e2ffe33-8e96-4058-91e2-e4ed1895c40d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:29.483313 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-4e2ffe33-8e96-4058-91e2-e4ed1895c40d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:29.489752 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4e2ffe33-8e96-4058-91e2-e4ed1895c40d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:29.490231 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4e2ffe33-8e96-4058-91e2-e4ed1895c40d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:29.490659 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4e2ffe33-8e96-4058-91e2-e4ed1895c40d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:29.491340 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4e2ffe33-8e96-4058-91e2-e4ed1895c40d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:29.491784 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4e2ffe33-8e96-4058-91e2-e4ed1895c40d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:29.492238 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4e2ffe33-8e96-4058-91e2-e4ed1895c40d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:29.623219 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-4e2ffe33-8e96-4058-91e2-e4ed1895c40d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:29.631601 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-4e2ffe33-8e96-4058-91e2-e4ed1895c40d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1357 microversion: 2.1 time: 0.152776 Oct 30 01:07:29.632193 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 568/1156] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:29 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:30.655563 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-62592dce-8323-48a1-a169-80cfc191c511 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:30.656387 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-62592dce-8323-48a1-a169-80cfc191c511 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:30.662488 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-62592dce-8323-48a1-a169-80cfc191c511 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:30.662967 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-62592dce-8323-48a1-a169-80cfc191c511 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:30.663404 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-62592dce-8323-48a1-a169-80cfc191c511 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:30.664102 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-62592dce-8323-48a1-a169-80cfc191c511 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:30.664567 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-62592dce-8323-48a1-a169-80cfc191c511 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:30.664987 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-62592dce-8323-48a1-a169-80cfc191c511 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:30.793465 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-62592dce-8323-48a1-a169-80cfc191c511 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:30.801889 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-62592dce-8323-48a1-a169-80cfc191c511 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1357 microversion: 2.1 time: 0.150977 Oct 30 01:07:30.802459 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 589/1157] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:30 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:31.825367 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-2f49c1b8-c56f-42aa-9bf0-e127f9137c85 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:31.825911 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-2f49c1b8-c56f-42aa-9bf0-e127f9137c85 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:31.833354 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2f49c1b8-c56f-42aa-9bf0-e127f9137c85 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:31.833836 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2f49c1b8-c56f-42aa-9bf0-e127f9137c85 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:31.834271 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2f49c1b8-c56f-42aa-9bf0-e127f9137c85 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:31.834958 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2f49c1b8-c56f-42aa-9bf0-e127f9137c85 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:31.835413 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2f49c1b8-c56f-42aa-9bf0-e127f9137c85 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:31.835844 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2f49c1b8-c56f-42aa-9bf0-e127f9137c85 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:31.968290 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-2f49c1b8-c56f-42aa-9bf0-e127f9137c85 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:31.976004 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-2f49c1b8-c56f-42aa-9bf0-e127f9137c85 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1548 microversion: 2.1 time: 0.154619 Oct 30 01:07:31.976597 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 569/1158] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:31 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:31.998822 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-0125d009-7f6b-498d-b0fe-d89e45fac572 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:32.000247 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-0125d009-7f6b-498d-b0fe-d89e45fac572 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:32.006698 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0125d009-7f6b-498d-b0fe-d89e45fac572 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:32.007169 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0125d009-7f6b-498d-b0fe-d89e45fac572 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:32.007597 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0125d009-7f6b-498d-b0fe-d89e45fac572 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:32.008303 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0125d009-7f6b-498d-b0fe-d89e45fac572 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:32.008748 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0125d009-7f6b-498d-b0fe-d89e45fac572 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:32.009161 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0125d009-7f6b-498d-b0fe-d89e45fac572 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:32.134786 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-0125d009-7f6b-498d-b0fe-d89e45fac572 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:32.142418 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-0125d009-7f6b-498d-b0fe-d89e45fac572 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1548 microversion: 2.1 time: 0.147388 Oct 30 01:07:32.142978 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 590/1159] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:31 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:32.163951 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-43e4e61f-1f58-4558-b7a4-a041c9dfb651 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:32.168772 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-43e4e61f-1f58-4558-b7a4-a041c9dfb651 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:32.169529 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-43e4e61f-1f58-4558-b7a4-a041c9dfb651 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Searching by: {'deleted': False, 'project_id': '4012d80a074641cc80074df4f602d9f0'} {{(pid=125553) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 30 01:07:32.176806 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-43e4e61f-1f58-4558-b7a4-a041c9dfb651 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:32.177283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-43e4e61f-1f58-4558-b7a4-a041c9dfb651 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:32.177715 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-43e4e61f-1f58-4558-b7a4-a041c9dfb651 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:32.178446 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-43e4e61f-1f58-4558-b7a4-a041c9dfb651 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:32.178900 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-43e4e61f-1f58-4558-b7a4-a041c9dfb651 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:32.179323 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-43e4e61f-1f58-4558-b7a4-a041c9dfb651 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:32.267799 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.multi_cell_list [None req-43e4e61f-1f58-4558-b7a4-a041c9dfb651 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125553) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 30 01:07:32.368529 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-43e4e61f-1f58-4558-b7a4-a041c9dfb651 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.208110 Oct 30 01:07:32.369018 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 570/1160] 10.222.0.36 () {58 vars in 1125 bytes} [Sun Oct 30 01:07:32 2022] GET /compute/v2.1/servers => generated 342 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:07:32.380980 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-628b00da-ca24-4d5e-9b30-e3dba6d080ed tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:32.381584 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-628b00da-ca24-4d5e-9b30-e3dba6d080ed tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:32.387379 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-628b00da-ca24-4d5e-9b30-e3dba6d080ed tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:32.387847 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-628b00da-ca24-4d5e-9b30-e3dba6d080ed tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:32.388308 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-628b00da-ca24-4d5e-9b30-e3dba6d080ed tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:32.388984 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-628b00da-ca24-4d5e-9b30-e3dba6d080ed tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:32.389432 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-628b00da-ca24-4d5e-9b30-e3dba6d080ed tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:32.389872 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-628b00da-ca24-4d5e-9b30-e3dba6d080ed tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:32.517973 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-628b00da-ca24-4d5e-9b30-e3dba6d080ed tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:32.525622 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-628b00da-ca24-4d5e-9b30-e3dba6d080ed tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1548 microversion: 2.1 time: 0.148518 Oct 30 01:07:32.526391 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 591/1161] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:32 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:34.080243 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c479f677-0c4e-4b7c-891d-882dc675bebd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "066b6cd5-c8ee-4dd7-a544-5b3705cd16f4"}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:07:34.083096 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-c479f677-0c4e-4b7c-891d-882dc675bebd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:34.090440 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c479f677-0c4e-4b7c-891d-882dc675bebd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:34.090942 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c479f677-0c4e-4b7c-891d-882dc675bebd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:34.091421 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c479f677-0c4e-4b7c-891d-882dc675bebd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:34.092469 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c479f677-0c4e-4b7c-891d-882dc675bebd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:34.093055 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c479f677-0c4e-4b7c-891d-882dc675bebd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:34.093658 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c479f677-0c4e-4b7c-891d-882dc675bebd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:34.352875 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c479f677-0c4e-4b7c-891d-882dc675bebd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "POST /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276488 Oct 30 01:07:34.353554 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 571/1162] 10.222.0.36 () {60 vars in 1323 bytes} [Sun Oct 30 01:07:34 2022] POST /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:07:41.948222 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-8808ab92-493a-4101-bf19-105af9f1ad59 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:41.948833 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-8808ab92-493a-4101-bf19-105af9f1ad59 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:41.951581 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 01:07:41.951720 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Sun Oct 30 01:07:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 (ip 10.222.0.36) !!! Oct 30 01:07:41.953465 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:07:41.963915 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8808ab92-493a-4101-bf19-105af9f1ad59 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:41.964426 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8808ab92-493a-4101-bf19-105af9f1ad59 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:41.964860 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8808ab92-493a-4101-bf19-105af9f1ad59 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:41.965563 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8808ab92-493a-4101-bf19-105af9f1ad59 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:41.966013 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8808ab92-493a-4101-bf19-105af9f1ad59 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:41.966439 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8808ab92-493a-4101-bf19-105af9f1ad59 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:41.969620 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=77 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:07:42.097443 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-8808ab92-493a-4101-bf19-105af9f1ad59 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:42.106100 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-8808ab92-493a-4101-bf19-105af9f1ad59 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1594 microversion: 2.1 time: 0.161733 Oct 30 01:07:42.106659 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 592/1163] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:41 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1594 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:43.999553 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=2 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:07:44.089655 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:07:44.171780 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-43dad8bc-eb9c-4a06-bf29-bab22eab752d req-0b88db23-8c0a-4147-9fd2-19785f7c0df8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9", "tag": "2f2d3a7d-dcac-4dcb-a220-b51bd1719f54"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:07:44.186263 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-43dad8bc-eb9c-4a06-bf29-bab22eab752d req-0b88db23-8c0a-4147-9fd2-19785f7c0df8 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:44.187017 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-43dad8bc-eb9c-4a06-bf29-bab22eab752d req-0b88db23-8c0a-4147-9fd2-19785f7c0df8 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:44.188509 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-43dad8bc-eb9c-4a06-bf29-bab22eab752d req-0b88db23-8c0a-4147-9fd2-19785f7c0df8 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:44.194049 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:07:44.203498 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-43dad8bc-eb9c-4a06-bf29-bab22eab752d req-0b88db23-8c0a-4147-9fd2-19785f7c0df8 service nova] Creating event network-changed:2f2d3a7d-dcac-4dcb-a220-b51bd1719f54 for instance 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 on hv-cinder-86149 Oct 30 01:07:44.209839 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-43dad8bc-eb9c-4a06-bf29-bab22eab752d req-0b88db23-8c0a-4147-9fd2-19785f7c0df8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212188 Oct 30 01:07:44.211097 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 572/1164] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:07:45.100337 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2ee3ee2b-1dc9-4ee3-92f7-aa2a55babcad tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1698629715"}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:07:45.100858 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2ee3ee2b-1dc9-4ee3-92f7-aa2a55babcad tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:45.106942 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ee3ee2b-1dc9-4ee3-92f7-aa2a55babcad tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:45.108189 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ee3ee2b-1dc9-4ee3-92f7-aa2a55babcad tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:45.108700 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ee3ee2b-1dc9-4ee3-92f7-aa2a55babcad tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:45.109457 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ee3ee2b-1dc9-4ee3-92f7-aa2a55babcad tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:45.109998 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ee3ee2b-1dc9-4ee3-92f7-aa2a55babcad tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:45.110483 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ee3ee2b-1dc9-4ee3-92f7-aa2a55babcad tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:45.247398 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.network.security_group_api [None req-2ee3ee2b-1dc9-4ee3-92f7-aa2a55babcad tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Adding security group 5543d8b7-c435-494d-a3e7-aff76c7e9284 to port 2f2d3a7d-dcac-4dcb-a220-b51bd1719f54 Oct 30 01:07:45.558691 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2ee3ee2b-1dc9-4ee3-92f7-aa2a55babcad tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "POST /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9/action" status: 202 len: 0 microversion: 2.1 time: 0.462551 Oct 30 01:07:45.559304 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 593/1165] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Oct 30 01:07:45 2022] POST /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:07:45.568888 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d9459e95-ee0e-41d4-976b-96857ba797da tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:07:45.569589 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d9459e95-ee0e-41d4-976b-96857ba797da tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:07:45.577604 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d9459e95-ee0e-41d4-976b-96857ba797da tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:45.578089 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d9459e95-ee0e-41d4-976b-96857ba797da tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:45.578529 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d9459e95-ee0e-41d4-976b-96857ba797da tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:45.579229 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d9459e95-ee0e-41d4-976b-96857ba797da tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:45.579679 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d9459e95-ee0e-41d4-976b-96857ba797da tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:45.580127 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d9459e95-ee0e-41d4-976b-96857ba797da tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:45.731506 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d9459e95-ee0e-41d4-976b-96857ba797da tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:07:45.746378 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d9459e95-ee0e-41d4-976b-96857ba797da tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1760 microversion: 2.1 time: 0.182698 Oct 30 01:07:45.746958 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 573/1166] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:07:45 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1760 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:07:46.226361 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-45b500b9-1614-446b-9985-b3b94527682f req-82720d92-12b8-4a2c-b6e0-3e59a2276280 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9", "tag": "2f2d3a7d-dcac-4dcb-a220-b51bd1719f54"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:07:46.235704 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-45b500b9-1614-446b-9985-b3b94527682f req-82720d92-12b8-4a2c-b6e0-3e59a2276280 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:07:46.236205 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-45b500b9-1614-446b-9985-b3b94527682f req-82720d92-12b8-4a2c-b6e0-3e59a2276280 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:07:46.236630 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-45b500b9-1614-446b-9985-b3b94527682f req-82720d92-12b8-4a2c-b6e0-3e59a2276280 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:07:46.248015 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-45b500b9-1614-446b-9985-b3b94527682f req-82720d92-12b8-4a2c-b6e0-3e59a2276280 service nova] Creating event network-changed:2f2d3a7d-dcac-4dcb-a220-b51bd1719f54 for instance 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 on hv-cinder-86149 Oct 30 01:07:46.252991 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-45b500b9-1614-446b-9985-b3b94527682f req-82720d92-12b8-4a2c-b6e0-3e59a2276280 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030876 Oct 30 01:07:46.253578 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 594/1167] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:08:33.300416 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-91f4193f-73de-41a0-b3da-397cd441f174 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:33.301025 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-91f4193f-73de-41a0-b3da-397cd441f174 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:33.303471 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=4 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:08:33.304157 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=7 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:08:33.309649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-91f4193f-73de-41a0-b3da-397cd441f174 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:33.310124 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-91f4193f-73de-41a0-b3da-397cd441f174 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:33.310552 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-91f4193f-73de-41a0-b3da-397cd441f174 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:33.311229 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-91f4193f-73de-41a0-b3da-397cd441f174 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:33.311672 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-91f4193f-73de-41a0-b3da-397cd441f174 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:33.312109 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-91f4193f-73de-41a0-b3da-397cd441f174 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:33.337838 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-91f4193f-73de-41a0-b3da-397cd441f174 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Going to try to terminate instance {{(pid=125553) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:08:33.415504 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-91f4193f-73de-41a0-b3da-397cd441f174 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "DELETE /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 204 len: 0 microversion: 2.1 time: 0.118730 Oct 30 01:08:33.416512 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 574/1168] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 01:08:33 2022] DELETE /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:08:33.422364 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=5 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:08:33.423166 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=11 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:08:33.427414 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2ec61db2-5561-4b4f-be24-59139e1bb7d2 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:33.428295 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2ec61db2-5561-4b4f-be24-59139e1bb7d2 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:33.435148 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ec61db2-5561-4b4f-be24-59139e1bb7d2 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:33.435628 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ec61db2-5561-4b4f-be24-59139e1bb7d2 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:33.436062 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ec61db2-5561-4b4f-be24-59139e1bb7d2 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:33.436783 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ec61db2-5561-4b4f-be24-59139e1bb7d2 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:33.437233 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ec61db2-5561-4b4f-be24-59139e1bb7d2 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:33.437657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2ec61db2-5561-4b4f-be24-59139e1bb7d2 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:33.571383 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-2ec61db2-5561-4b4f-be24-59139e1bb7d2 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:33.579030 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2ec61db2-5561-4b4f-be24-59139e1bb7d2 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 200 len: 1578 microversion: 2.1 time: 0.158270 Oct 30 01:08:33.579581 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 595/1169] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:33 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:34.604287 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5e6192f4-427a-4e74-a0b2-848dd220c338 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:34.605020 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5e6192f4-427a-4e74-a0b2-848dd220c338 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:34.611646 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5e6192f4-427a-4e74-a0b2-848dd220c338 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:34.612160 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5e6192f4-427a-4e74-a0b2-848dd220c338 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:34.612598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5e6192f4-427a-4e74-a0b2-848dd220c338 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:34.613294 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5e6192f4-427a-4e74-a0b2-848dd220c338 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:34.613746 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5e6192f4-427a-4e74-a0b2-848dd220c338 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:34.614170 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5e6192f4-427a-4e74-a0b2-848dd220c338 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:34.799535 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5e6192f4-427a-4e74-a0b2-848dd220c338 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:34.807279 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5e6192f4-427a-4e74-a0b2-848dd220c338 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 200 len: 1578 microversion: 2.1 time: 0.207265 Oct 30 01:08:34.807835 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 575/1170] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:34 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 1578 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:35.830818 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c8d35647-5624-418f-b801-ed04c0d0fee3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:35.831392 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c8d35647-5624-418f-b801-ed04c0d0fee3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:35.838271 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c8d35647-5624-418f-b801-ed04c0d0fee3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:35.838744 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c8d35647-5624-418f-b801-ed04c0d0fee3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:35.839170 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c8d35647-5624-418f-b801-ed04c0d0fee3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:35.839852 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c8d35647-5624-418f-b801-ed04c0d0fee3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:35.840316 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c8d35647-5624-418f-b801-ed04c0d0fee3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:35.840734 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c8d35647-5624-418f-b801-ed04c0d0fee3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:35.974770 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c8d35647-5624-418f-b801-ed04c0d0fee3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:35.982838 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c8d35647-5624-418f-b801-ed04c0d0fee3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 200 len: 1578 microversion: 2.1 time: 0.155926 Oct 30 01:08:35.989456 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 596/1171] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:35 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:36.278727 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-7933f724-9f9a-46a0-9be5-7028dfd646df req-a3cd29be-17e8-4eab-8c69-c60ea049080f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb312adb-3d03-43c7-aadf-adc7cc771e65", "name": "network-vif-deleted", "tag": "d30b3add-32a3-4ae5-8567-e6dd0db6daa5"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:08:36.291210 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-7933f724-9f9a-46a0-9be5-7028dfd646df req-a3cd29be-17e8-4eab-8c69-c60ea049080f service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:36.291679 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-7933f724-9f9a-46a0-9be5-7028dfd646df req-a3cd29be-17e8-4eab-8c69-c60ea049080f service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:36.292131 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-7933f724-9f9a-46a0-9be5-7028dfd646df req-a3cd29be-17e8-4eab-8c69-c60ea049080f service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:36.305316 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-7933f724-9f9a-46a0-9be5-7028dfd646df req-a3cd29be-17e8-4eab-8c69-c60ea049080f service nova] Creating event network-vif-deleted:d30b3add-32a3-4ae5-8567-e6dd0db6daa5 for instance eb312adb-3d03-43c7-aadf-adc7cc771e65 on hv-cinder-86149 Oct 30 01:08:36.311028 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-7933f724-9f9a-46a0-9be5-7028dfd646df req-a3cd29be-17e8-4eab-8c69-c60ea049080f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035924 Oct 30 01:08:36.311895 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 576/1172] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:08:37.006927 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-aa6125c5-5202-407e-ba0c-5703c99eafe3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:37.007530 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-aa6125c5-5202-407e-ba0c-5703c99eafe3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:37.014110 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-aa6125c5-5202-407e-ba0c-5703c99eafe3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:37.014585 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-aa6125c5-5202-407e-ba0c-5703c99eafe3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:37.015016 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-aa6125c5-5202-407e-ba0c-5703c99eafe3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:37.015705 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-aa6125c5-5202-407e-ba0c-5703c99eafe3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:37.016174 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-aa6125c5-5202-407e-ba0c-5703c99eafe3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:37.016592 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-aa6125c5-5202-407e-ba0c-5703c99eafe3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:37.050405 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-aa6125c5-5202-407e-ba0c-5703c99eafe3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:37.050917 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-aa6125c5-5202-407e-ba0c-5703c99eafe3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:37.051358 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-aa6125c5-5202-407e-ba0c-5703c99eafe3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:37.051808 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.objects.instance [None req-aa6125c5-5202-407e-ba0c-5703c99eafe3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lazy-loading 'fault' on Instance uuid eb312adb-3d03-43c7-aadf-adc7cc771e65 {{(pid=125554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:08:37.153602 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-aa6125c5-5202-407e-ba0c-5703c99eafe3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:37.162402 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-aa6125c5-5202-407e-ba0c-5703c99eafe3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 200 len: 1231 microversion: 2.1 time: 0.159117 Oct 30 01:08:37.163406 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 597/1173] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:37 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 1231 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:38.186439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c7987a87-093c-40ea-bd7f-80bd52565cc3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:38.187138 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-c7987a87-093c-40ea-bd7f-80bd52565cc3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:38.194470 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c7987a87-093c-40ea-bd7f-80bd52565cc3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:38.194946 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c7987a87-093c-40ea-bd7f-80bd52565cc3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:38.195377 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c7987a87-093c-40ea-bd7f-80bd52565cc3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:38.196067 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c7987a87-093c-40ea-bd7f-80bd52565cc3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:38.196533 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c7987a87-093c-40ea-bd7f-80bd52565cc3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:38.196951 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c7987a87-093c-40ea-bd7f-80bd52565cc3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:38.211753 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-c7987a87-093c-40ea-bd7f-80bd52565cc3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] HTTP exception thrown: Instance eb312adb-3d03-43c7-aadf-adc7cc771e65 could not be found. Oct 30 01:08:38.213426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c7987a87-093c-40ea-bd7f-80bd52565cc3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Request method failure captured: Oct 30 01:08:38.213426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 HTTP/1.1 Oct 30 01:08:38.213426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 01:08:38.213426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 01:08:38.213426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 01:08:38.213426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 01:08:38.213426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 01:08:38.213426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 01:08:38.213426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 01:08:38.213426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 01:08:38.213426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXc3U7zEArvqu2QGSA-clD8ha0CewgqJFH1q4iJxZVv7K0xIiIecT4jsir217BP3qBgrKVdHygaUsKTS2mC8JxKRvp19cjhydcjuAq8s23ZYKz9z1WMgOFIeD2dofXB0mBImFj0zEPzSwdDHUv8rAXkyfybgvaf8Pnk5g2iGR6ncL6SY Oct 30 01:08:38.213426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 01:08:38.213426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 01:08:38.213426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 01:08:38.213426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 01:08:38.213426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 01:08:38.213426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 01:08:38.213426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: a8a24adf04bb4adfbc7347a5e4ec6b52 Oct 30 01:08:38.213426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-TestVolumeBootPattern-243364429 Oct 30 01:08:38.213426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 01:08:38.213426 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 01:08:38.215177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a8a24adf04bb4adfbc7347a5e4ec6b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8a24adf04bb4adfbc7347a5e4ec6b52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a8a24adf04bb4adfbc7347a5e4ec6b52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8a24adf04bb4adfbc7347a5e4ec6b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:08:38.215177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-TestVolumeBootPattern-243364429 Oct 30 01:08:38.215177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: a8a24adf04bb4adfbc7347a5e4ec6b52 Oct 30 01:08:38.215177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-TestVolumeBootPattern-243364429 Oct 30 01:08:38.215177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-TestVolumeBootPattern-243364429-project Oct 30 01:08:38.215177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 01:08:38.215177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 01:08:38.215177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: d6d3fe4f3fbb4dedb7a0703a2bb6884d Oct 30 01:08:38.215177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-TestVolumeBootPattern-243364429-project Oct 30 01:08:38.215177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: > Oct 30 01:08:38.215177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Instance eb312adb-3d03-43c7-aadf-adc7cc771e65 could not be found. Oct 30 01:08:38.215177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': 'eb312adb-3d03-43c7-aadf-adc7cc771e65'} Oct 30 01:08:38.216192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:08:38.216192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:08:38.216192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:08:38.216192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:08:38.216192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:08:38.216192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:08:38.216192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:08:38.216192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:08:38.216192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:08:38.216192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:08:38.216192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb312adb-3d03-43c7-aadf-adc7cc771e65 could not be found. Oct 30 01:08:38.216192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:08:38.216192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:08:38.216192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:08:38.216192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:08:38.216192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:08:38.216192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:08:38.216192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:08:38.216192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:08:38.216192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:08:38.217661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:08:38.217661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:08:38.217661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:08:38.217661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:08:38.217661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:08:38.217661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:08:38.217661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:08:38.217661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb312adb-3d03-43c7-aadf-adc7cc771e65 could not be found. Oct 30 01:08:38.217661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:08:38.217661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:08:38.217661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:08:38.217661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:08:38.217661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:08:38.217661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:08:38.217661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:08:38.217661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:08:38.217661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb312adb-3d03-43c7-aadf-adc7cc771e65 could not be found. Oct 30 01:08:38.217661 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:08:38.218984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c7987a87-093c-40ea-bd7f-80bd52565cc3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Returning 404 to user: Instance eb312adb-3d03-43c7-aadf-adc7cc771e65 could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:08:38.218984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c7987a87-093c-40ea-bd7f-80bd52565cc3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 404 len: 111 microversion: 2.1 time: 0.032529 Oct 30 01:08:38.218984 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 577/1174] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:38 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:08:38.311625 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-cd801ac2-9f9f-49a9-887c-64948425d7a8 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1813407551", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1905451183", "security_groups": [{"name": "tempest-secgroup-smoke-1393638939"}], "block_device_mapping_v2": [{"uuid": "aad15af0-f3a0-4766-8df3-4e6ee0a6bcff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e079eebe-8fcb-409d-9370-b9e72d108471"}]}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:08:38.431045 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.network.neutron [None req-cd801ac2-9f9f-49a9-887c-64948425d7a8 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] validate_networks() for [('e079eebe-8fcb-409d-9370-b9e72d108471', None, None, None, None, None)] {{(pid=125554) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:08:38.800049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-cd801ac2-9f9f-49a9-887c-64948425d7a8 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Flavor limits 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:08:38.800504 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-cd801ac2-9f9f-49a9-887c-64948425d7a8 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Image limits 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:08:38.800975 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-cd801ac2-9f9f-49a9-887c-64948425d7a8 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Flavor pref 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:08:38.801383 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-cd801ac2-9f9f-49a9-887c-64948425d7a8 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Image pref 0:0:0 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:08:38.801792 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.virt.hardware [None req-cd801ac2-9f9f-49a9-887c-64948425d7a8 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125554) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:08:38.810525 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cd801ac2-9f9f-49a9-887c-64948425d7a8 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:38.810999 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cd801ac2-9f9f-49a9-887c-64948425d7a8 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:38.811434 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cd801ac2-9f9f-49a9-887c-64948425d7a8 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:38.812180 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cd801ac2-9f9f-49a9-887c-64948425d7a8 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:38.812629 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cd801ac2-9f9f-49a9-887c-64948425d7a8 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:38.813049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cd801ac2-9f9f-49a9-887c-64948425d7a8 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:38.829970 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-cd801ac2-9f9f-49a9-887c-64948425d7a8 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Getting quotas for project a8a24adf04bb4adfbc7347a5e4ec6b52. Resources: {'instances', 'cores', 'ram'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:08:38.833872 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.quota [None req-cd801ac2-9f9f-49a9-887c-64948425d7a8 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Getting quotas for user d6d3fe4f3fbb4dedb7a0703a2bb6884d and project a8a24adf04bb4adfbc7347a5e4ec6b52. Resources: {'instances', 'cores', 'ram'} {{(pid=125554) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:08:38.893256 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-cd801ac2-9f9f-49a9-887c-64948425d7a8 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Going to run 1 instances... {{(pid=125554) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:08:38.895372 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-cd801ac2-9f9f-49a9-887c-64948425d7a8 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aad15af0-f3a0-4766-8df3-4e6ee0a6bcff',volume_size=None,volume_type=None)] {{(pid=125554) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:08:39.028332 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-cd801ac2-9f9f-49a9-887c-64948425d7a8 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.720507 Oct 30 01:08:39.029133 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 598/1175] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Oct 30 01:08:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 30 01:08:39.040306 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5f327884-90ad-4c91-9919-cb6d44e72b1f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:39.040924 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5f327884-90ad-4c91-9919-cb6d44e72b1f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:39.098813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-5f327884-90ad-4c91-9919-cb6d44e72b1f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:39.106108 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5f327884-90ad-4c91-9919-cb6d44e72b1f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5" status: 200 len: 1095 microversion: 2.1 time: 0.069900 Oct 30 01:08:39.106697 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 578/1176] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:39 2022] GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:40.131018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-bfe5ac5c-9084-4bf9-8248-9baeff072c74 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:40.131756 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-bfe5ac5c-9084-4bf9-8248-9baeff072c74 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:40.139012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bfe5ac5c-9084-4bf9-8248-9baeff072c74 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:40.139836 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bfe5ac5c-9084-4bf9-8248-9baeff072c74 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:40.140331 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bfe5ac5c-9084-4bf9-8248-9baeff072c74 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:40.141233 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bfe5ac5c-9084-4bf9-8248-9baeff072c74 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:40.141793 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bfe5ac5c-9084-4bf9-8248-9baeff072c74 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:40.142225 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-bfe5ac5c-9084-4bf9-8248-9baeff072c74 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:40.209178 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-bfe5ac5c-9084-4bf9-8248-9baeff072c74 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:40.217303 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-bfe5ac5c-9084-4bf9-8248-9baeff072c74 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5" status: 200 len: 1201 microversion: 2.1 time: 0.090317 Oct 30 01:08:40.217871 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 599/1177] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:40 2022] GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 => generated 1201 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:41.241455 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e5659f72-3da2-4fa0-9753-f4be071cf109 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:41.242021 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-e5659f72-3da2-4fa0-9753-f4be071cf109 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:41.249907 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e5659f72-3da2-4fa0-9753-f4be071cf109 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:41.250476 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e5659f72-3da2-4fa0-9753-f4be071cf109 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:41.250827 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e5659f72-3da2-4fa0-9753-f4be071cf109 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:41.251523 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e5659f72-3da2-4fa0-9753-f4be071cf109 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:41.251977 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e5659f72-3da2-4fa0-9753-f4be071cf109 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:41.252430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e5659f72-3da2-4fa0-9753-f4be071cf109 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:41.385226 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-e5659f72-3da2-4fa0-9753-f4be071cf109 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:41.393088 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e5659f72-3da2-4fa0-9753-f4be071cf109 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5" status: 200 len: 1267 microversion: 2.1 time: 0.155545 Oct 30 01:08:41.393646 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 579/1178] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:41 2022] GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:41.564636 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-e63a488a-1448-4956-83b7-af3494abc21c req-dbaaed35-6592-4b4e-a472-ff45fc608e01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a96b858-272d-4c54-a3f4-e2d20a8ec7f5", "tag": "5baac346-1954-45fd-802a-77c919eb50ce"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:08:41.576243 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-e63a488a-1448-4956-83b7-af3494abc21c req-dbaaed35-6592-4b4e-a472-ff45fc608e01 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:41.576710 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-e63a488a-1448-4956-83b7-af3494abc21c req-dbaaed35-6592-4b4e-a472-ff45fc608e01 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:41.577126 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-e63a488a-1448-4956-83b7-af3494abc21c req-dbaaed35-6592-4b4e-a472-ff45fc608e01 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:41.590048 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-e63a488a-1448-4956-83b7-af3494abc21c req-dbaaed35-6592-4b4e-a472-ff45fc608e01 service nova] Creating event network-changed:5baac346-1954-45fd-802a-77c919eb50ce for instance 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 on hv-cinder-86149 Oct 30 01:08:41.595013 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-e63a488a-1448-4956-83b7-af3494abc21c req-dbaaed35-6592-4b4e-a472-ff45fc608e01 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033973 Oct 30 01:08:41.595785 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 600/1179] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:08:42.416586 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-bebf2f00-875d-4c61-a405-2d267afbd956 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:42.417189 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-bebf2f00-875d-4c61-a405-2d267afbd956 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:42.423886 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bebf2f00-875d-4c61-a405-2d267afbd956 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:42.424399 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bebf2f00-875d-4c61-a405-2d267afbd956 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:42.424836 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bebf2f00-875d-4c61-a405-2d267afbd956 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:42.425536 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bebf2f00-875d-4c61-a405-2d267afbd956 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:42.425989 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bebf2f00-875d-4c61-a405-2d267afbd956 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:42.426412 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-bebf2f00-875d-4c61-a405-2d267afbd956 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:42.558952 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-bebf2f00-875d-4c61-a405-2d267afbd956 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:42.566607 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-bebf2f00-875d-4c61-a405-2d267afbd956 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5" status: 200 len: 1267 microversion: 2.1 time: 0.153883 Oct 30 01:08:42.567419 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 580/1180] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:42 2022] GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:43.590769 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-6c7edbb9-9233-45f2-ab80-b6b3f373e644 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:43.591441 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-6c7edbb9-9233-45f2-ab80-b6b3f373e644 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:43.597531 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6c7edbb9-9233-45f2-ab80-b6b3f373e644 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:43.598007 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6c7edbb9-9233-45f2-ab80-b6b3f373e644 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:43.598440 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6c7edbb9-9233-45f2-ab80-b6b3f373e644 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:43.599125 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6c7edbb9-9233-45f2-ab80-b6b3f373e644 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:43.599578 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6c7edbb9-9233-45f2-ab80-b6b3f373e644 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:43.599999 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6c7edbb9-9233-45f2-ab80-b6b3f373e644 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:43.731075 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6c7edbb9-9233-45f2-ab80-b6b3f373e644 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:43.738660 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-6c7edbb9-9233-45f2-ab80-b6b3f373e644 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5" status: 200 len: 1267 microversion: 2.1 time: 0.152730 Oct 30 01:08:43.739225 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 601/1181] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:43 2022] GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:44.764775 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-4a360a57-37e4-4784-9649-077c77926166 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:44.765386 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-4a360a57-37e4-4784-9649-077c77926166 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:44.771899 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4a360a57-37e4-4784-9649-077c77926166 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:44.772413 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4a360a57-37e4-4784-9649-077c77926166 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:44.772848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4a360a57-37e4-4784-9649-077c77926166 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:44.773538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4a360a57-37e4-4784-9649-077c77926166 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:44.773989 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4a360a57-37e4-4784-9649-077c77926166 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:44.774420 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4a360a57-37e4-4784-9649-077c77926166 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:44.908849 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-4a360a57-37e4-4784-9649-077c77926166 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:44.917091 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-4a360a57-37e4-4784-9649-077c77926166 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5" status: 200 len: 1267 microversion: 2.1 time: 0.156177 Oct 30 01:08:44.917649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 581/1182] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:44 2022] GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:45.941263 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-cb49bd0b-a0db-4719-941b-cb9ba6be55e1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:45.942448 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-cb49bd0b-a0db-4719-941b-cb9ba6be55e1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:45.949070 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cb49bd0b-a0db-4719-941b-cb9ba6be55e1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:45.949543 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cb49bd0b-a0db-4719-941b-cb9ba6be55e1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:45.949971 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cb49bd0b-a0db-4719-941b-cb9ba6be55e1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:45.950652 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cb49bd0b-a0db-4719-941b-cb9ba6be55e1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:45.951131 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cb49bd0b-a0db-4719-941b-cb9ba6be55e1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:45.951547 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-cb49bd0b-a0db-4719-941b-cb9ba6be55e1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:46.084509 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-cb49bd0b-a0db-4719-941b-cb9ba6be55e1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:46.092699 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-cb49bd0b-a0db-4719-941b-cb9ba6be55e1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5" status: 200 len: 1267 microversion: 2.1 time: 0.156237 Oct 30 01:08:46.093252 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 602/1183] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:45 2022] GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:46.488560 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-cce59bc5-e80f-4185-bcc7-c60fa9fd3e8d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:08:46.490858 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-cce59bc5-e80f-4185-bcc7-c60fa9fd3e8d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:46.497893 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cce59bc5-e80f-4185-bcc7-c60fa9fd3e8d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:46.498376 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cce59bc5-e80f-4185-bcc7-c60fa9fd3e8d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:46.498811 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cce59bc5-e80f-4185-bcc7-c60fa9fd3e8d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:46.499501 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cce59bc5-e80f-4185-bcc7-c60fa9fd3e8d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:46.499955 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cce59bc5-e80f-4185-bcc7-c60fa9fd3e8d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:46.500406 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cce59bc5-e80f-4185-bcc7-c60fa9fd3e8d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:46.572607 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-cce59bc5-e80f-4185-bcc7-c60fa9fd3e8d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "POST /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9/action" status: 202 len: 0 microversion: 2.1 time: 0.087172 Oct 30 01:08:46.576875 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 582/1184] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Oct 30 01:08:46 2022] POST /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:08:46.585734 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-e8fea409-20b1-49c7-b2f4-cfe4a1925ad4 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:46.586657 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-e8fea409-20b1-49c7-b2f4-cfe4a1925ad4 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:46.593758 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e8fea409-20b1-49c7-b2f4-cfe4a1925ad4 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:46.594243 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e8fea409-20b1-49c7-b2f4-cfe4a1925ad4 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:46.594683 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e8fea409-20b1-49c7-b2f4-cfe4a1925ad4 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:46.595378 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e8fea409-20b1-49c7-b2f4-cfe4a1925ad4 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:46.595829 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e8fea409-20b1-49c7-b2f4-cfe4a1925ad4 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:46.596278 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e8fea409-20b1-49c7-b2f4-cfe4a1925ad4 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:46.742811 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e8fea409-20b1-49c7-b2f4-cfe4a1925ad4 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:46.751575 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-e8fea409-20b1-49c7-b2f4-cfe4a1925ad4 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1752 microversion: 2.1 time: 0.170669 Oct 30 01:08:46.752160 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 603/1185] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:46 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:47.121244 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-4afa15ff-91bf-4308-b336-e3381f29a042 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:47.122214 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-4afa15ff-91bf-4308-b336-e3381f29a042 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:47.128690 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4afa15ff-91bf-4308-b336-e3381f29a042 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:47.129202 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4afa15ff-91bf-4308-b336-e3381f29a042 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:47.129676 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4afa15ff-91bf-4308-b336-e3381f29a042 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:47.130441 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4afa15ff-91bf-4308-b336-e3381f29a042 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:47.130891 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4afa15ff-91bf-4308-b336-e3381f29a042 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:47.131317 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4afa15ff-91bf-4308-b336-e3381f29a042 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:47.278293 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-4afa15ff-91bf-4308-b336-e3381f29a042 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:47.286375 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-4afa15ff-91bf-4308-b336-e3381f29a042 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5" status: 200 len: 1267 microversion: 2.1 time: 0.172446 Oct 30 01:08:47.286942 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 583/1186] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:47 2022] GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:47.774737 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-6b4922ac-d9ca-41da-8660-31f2934264b9 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:47.775372 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-6b4922ac-d9ca-41da-8660-31f2934264b9 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:47.781982 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6b4922ac-d9ca-41da-8660-31f2934264b9 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:47.782489 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6b4922ac-d9ca-41da-8660-31f2934264b9 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:47.782925 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6b4922ac-d9ca-41da-8660-31f2934264b9 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:47.783611 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6b4922ac-d9ca-41da-8660-31f2934264b9 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:47.784063 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6b4922ac-d9ca-41da-8660-31f2934264b9 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:47.784506 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6b4922ac-d9ca-41da-8660-31f2934264b9 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:47.930670 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6b4922ac-d9ca-41da-8660-31f2934264b9 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:47.939452 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-6b4922ac-d9ca-41da-8660-31f2934264b9 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1757 microversion: 2.1 time: 0.168563 Oct 30 01:08:47.940007 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 604/1187] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:47 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:48.310608 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1d109473-99c4-4700-8bb6-d3578a5698e0 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:48.311212 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1d109473-99c4-4700-8bb6-d3578a5698e0 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:48.317946 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1d109473-99c4-4700-8bb6-d3578a5698e0 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:48.318508 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1d109473-99c4-4700-8bb6-d3578a5698e0 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:48.318938 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1d109473-99c4-4700-8bb6-d3578a5698e0 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:48.319618 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1d109473-99c4-4700-8bb6-d3578a5698e0 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:48.320062 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1d109473-99c4-4700-8bb6-d3578a5698e0 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:48.320511 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1d109473-99c4-4700-8bb6-d3578a5698e0 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:48.456024 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-1d109473-99c4-4700-8bb6-d3578a5698e0 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:48.464290 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1d109473-99c4-4700-8bb6-d3578a5698e0 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5" status: 200 len: 1267 microversion: 2.1 time: 0.158038 Oct 30 01:08:48.464841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 584/1188] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:48 2022] GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:48.963380 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-e8a1b83d-2417-45dc-a4c4-db720be37d91 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:48.963988 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-e8a1b83d-2417-45dc-a4c4-db720be37d91 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:48.966389 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=2 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:08:48.967040 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=6 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:08:48.973221 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e8a1b83d-2417-45dc-a4c4-db720be37d91 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:48.973695 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e8a1b83d-2417-45dc-a4c4-db720be37d91 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:48.974125 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e8a1b83d-2417-45dc-a4c4-db720be37d91 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:48.974865 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e8a1b83d-2417-45dc-a4c4-db720be37d91 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:48.975309 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e8a1b83d-2417-45dc-a4c4-db720be37d91 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:48.975730 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-e8a1b83d-2417-45dc-a4c4-db720be37d91 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:49.114379 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-e8a1b83d-2417-45dc-a4c4-db720be37d91 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:49.123236 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-e8a1b83d-2417-45dc-a4c4-db720be37d91 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1757 microversion: 2.1 time: 0.163814 Oct 30 01:08:49.123791 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 605/1189] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:48 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:49.486452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-e1481098-afc9-4ffd-beca-19d400d5ad80 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:49.487067 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-e1481098-afc9-4ffd-beca-19d400d5ad80 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:49.489042 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=2 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:08:49.495769 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e1481098-afc9-4ffd-beca-19d400d5ad80 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:49.496287 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e1481098-afc9-4ffd-beca-19d400d5ad80 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:49.496729 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e1481098-afc9-4ffd-beca-19d400d5ad80 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:49.497422 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e1481098-afc9-4ffd-beca-19d400d5ad80 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:49.497901 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e1481098-afc9-4ffd-beca-19d400d5ad80 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:49.498325 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-e1481098-afc9-4ffd-beca-19d400d5ad80 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:49.634906 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-e1481098-afc9-4ffd-beca-19d400d5ad80 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:49.642569 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-e1481098-afc9-4ffd-beca-19d400d5ad80 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5" status: 200 len: 1267 microversion: 2.1 time: 0.159963 Oct 30 01:08:49.643135 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 585/1190] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:49 2022] GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:50.147569 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-22d6005d-4943-4c6f-9e34-d759aab22e77 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:50.148201 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-22d6005d-4943-4c6f-9e34-d759aab22e77 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:50.164110 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-22d6005d-4943-4c6f-9e34-d759aab22e77 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:50.164593 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-22d6005d-4943-4c6f-9e34-d759aab22e77 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:50.165026 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-22d6005d-4943-4c6f-9e34-d759aab22e77 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:50.165727 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-22d6005d-4943-4c6f-9e34-d759aab22e77 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:50.166171 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-22d6005d-4943-4c6f-9e34-d759aab22e77 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:50.166587 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-22d6005d-4943-4c6f-9e34-d759aab22e77 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:50.319305 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-22d6005d-4943-4c6f-9e34-d759aab22e77 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:50.328234 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-22d6005d-4943-4c6f-9e34-d759aab22e77 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1757 microversion: 2.1 time: 0.185153 Oct 30 01:08:50.328798 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 606/1191] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:50 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:50.666972 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-b8aba72f-f56e-4537-ae85-6b930233dfdd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:50.667573 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-b8aba72f-f56e-4537-ae85-6b930233dfdd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:50.674020 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b8aba72f-f56e-4537-ae85-6b930233dfdd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:50.674501 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b8aba72f-f56e-4537-ae85-6b930233dfdd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:50.674937 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b8aba72f-f56e-4537-ae85-6b930233dfdd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:50.675627 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b8aba72f-f56e-4537-ae85-6b930233dfdd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:50.676097 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b8aba72f-f56e-4537-ae85-6b930233dfdd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:50.676530 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-b8aba72f-f56e-4537-ae85-6b930233dfdd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:50.812198 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-b8aba72f-f56e-4537-ae85-6b930233dfdd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:50.820130 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-b8aba72f-f56e-4537-ae85-6b930233dfdd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5" status: 200 len: 1267 microversion: 2.1 time: 0.157729 Oct 30 01:08:50.820703 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 586/1192] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:50 2022] GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:51.351356 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-70b68f72-9e76-46d1-8b23-b151462c03cd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:51.352062 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-70b68f72-9e76-46d1-8b23-b151462c03cd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:51.359252 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-70b68f72-9e76-46d1-8b23-b151462c03cd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:51.360398 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-70b68f72-9e76-46d1-8b23-b151462c03cd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:51.360831 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-70b68f72-9e76-46d1-8b23-b151462c03cd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:51.361533 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-70b68f72-9e76-46d1-8b23-b151462c03cd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:51.362012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-70b68f72-9e76-46d1-8b23-b151462c03cd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:51.362433 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-70b68f72-9e76-46d1-8b23-b151462c03cd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:51.519094 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-70b68f72-9e76-46d1-8b23-b151462c03cd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:51.528319 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-70b68f72-9e76-46d1-8b23-b151462c03cd tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1757 microversion: 2.1 time: 0.180761 Oct 30 01:08:51.528903 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 607/1193] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:51 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:51.843350 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-86da6d0c-23d5-4d7d-a4be-242b2255bf79 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:51.843944 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-86da6d0c-23d5-4d7d-a4be-242b2255bf79 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:51.850840 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-86da6d0c-23d5-4d7d-a4be-242b2255bf79 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:51.851331 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-86da6d0c-23d5-4d7d-a4be-242b2255bf79 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:51.851773 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-86da6d0c-23d5-4d7d-a4be-242b2255bf79 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:51.852503 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-86da6d0c-23d5-4d7d-a4be-242b2255bf79 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:51.852963 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-86da6d0c-23d5-4d7d-a4be-242b2255bf79 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:51.853403 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-86da6d0c-23d5-4d7d-a4be-242b2255bf79 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:51.990472 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-86da6d0c-23d5-4d7d-a4be-242b2255bf79 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:51.998941 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-86da6d0c-23d5-4d7d-a4be-242b2255bf79 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5" status: 200 len: 1267 microversion: 2.1 time: 0.159531 Oct 30 01:08:51.999516 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 587/1194] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:51 2022] GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:52.561058 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f893b646-284a-424d-a011-f5936dd3f84d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:52.561656 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-f893b646-284a-424d-a011-f5936dd3f84d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:52.568431 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f893b646-284a-424d-a011-f5936dd3f84d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:52.569031 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f893b646-284a-424d-a011-f5936dd3f84d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:52.569461 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f893b646-284a-424d-a011-f5936dd3f84d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:52.570144 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f893b646-284a-424d-a011-f5936dd3f84d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:52.570588 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f893b646-284a-424d-a011-f5936dd3f84d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:52.571002 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f893b646-284a-424d-a011-f5936dd3f84d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:52.722086 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-f893b646-284a-424d-a011-f5936dd3f84d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:52.730969 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-f893b646-284a-424d-a011-f5936dd3f84d tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1757 microversion: 2.1 time: 0.174128 Oct 30 01:08:52.731539 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 608/1195] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:52 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:08:53.022793 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f93daa1a-eedd-468a-837f-1a43323acd4c tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:53.023397 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f93daa1a-eedd-468a-837f-1a43323acd4c tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:53.030863 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f93daa1a-eedd-468a-837f-1a43323acd4c tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:53.031337 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f93daa1a-eedd-468a-837f-1a43323acd4c tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:53.031785 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f93daa1a-eedd-468a-837f-1a43323acd4c tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:53.032476 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f93daa1a-eedd-468a-837f-1a43323acd4c tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:53.032923 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f93daa1a-eedd-468a-837f-1a43323acd4c tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:53.033341 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f93daa1a-eedd-468a-837f-1a43323acd4c tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:53.161601 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f93daa1a-eedd-468a-837f-1a43323acd4c tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:53.169481 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f93daa1a-eedd-468a-837f-1a43323acd4c tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5" status: 200 len: 1267 microversion: 2.1 time: 0.150548 Oct 30 01:08:53.170049 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 588/1196] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:53 2022] GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:53.493160 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-dddff261-cd7b-4b15-b162-51557062329f req-b72c4d58-8ac7-4b2c-a175-069dda4e8c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a96b858-272d-4c54-a3f4-e2d20a8ec7f5", "name": "network-vif-plugged", "status": "completed", "tag": "5baac346-1954-45fd-802a-77c919eb50ce"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:08:53.502887 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-dddff261-cd7b-4b15-b162-51557062329f req-b72c4d58-8ac7-4b2c-a175-069dda4e8c14 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:53.503342 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-dddff261-cd7b-4b15-b162-51557062329f req-b72c4d58-8ac7-4b2c-a175-069dda4e8c14 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:53.503778 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-dddff261-cd7b-4b15-b162-51557062329f req-b72c4d58-8ac7-4b2c-a175-069dda4e8c14 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:53.515192 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-dddff261-cd7b-4b15-b162-51557062329f req-b72c4d58-8ac7-4b2c-a175-069dda4e8c14 service nova] Creating event network-vif-plugged:5baac346-1954-45fd-802a-77c919eb50ce for instance 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 on hv-cinder-86149 Oct 30 01:08:53.520149 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-dddff261-cd7b-4b15-b162-51557062329f req-b72c4d58-8ac7-4b2c-a175-069dda4e8c14 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030647 Oct 30 01:08:53.520732 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 609/1197] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:08:53.754757 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f516798e-f060-4d5e-a53c-929f889180ef tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:53.755384 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f516798e-f060-4d5e-a53c-929f889180ef tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:53.762069 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f516798e-f060-4d5e-a53c-929f889180ef tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:53.762546 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f516798e-f060-4d5e-a53c-929f889180ef tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:53.762974 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f516798e-f060-4d5e-a53c-929f889180ef tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:53.763714 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f516798e-f060-4d5e-a53c-929f889180ef tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:53.764182 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f516798e-f060-4d5e-a53c-929f889180ef tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:53.764604 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f516798e-f060-4d5e-a53c-929f889180ef tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:53.912930 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f516798e-f060-4d5e-a53c-929f889180ef tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:53.921250 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f516798e-f060-4d5e-a53c-929f889180ef tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1757 microversion: 2.1 time: 0.170429 Oct 30 01:08:53.921809 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 589/1198] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:53 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:54.193748 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-8aeebfd2-0d95-4169-8dcc-51690462af00 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:54.194443 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-8aeebfd2-0d95-4169-8dcc-51690462af00 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:54.201321 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8aeebfd2-0d95-4169-8dcc-51690462af00 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:54.201895 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8aeebfd2-0d95-4169-8dcc-51690462af00 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:54.202329 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8aeebfd2-0d95-4169-8dcc-51690462af00 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:54.203020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8aeebfd2-0d95-4169-8dcc-51690462af00 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:54.203495 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8aeebfd2-0d95-4169-8dcc-51690462af00 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:54.203915 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8aeebfd2-0d95-4169-8dcc-51690462af00 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:54.337279 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-8aeebfd2-0d95-4169-8dcc-51690462af00 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:54.344878 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-8aeebfd2-0d95-4169-8dcc-51690462af00 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5" status: 200 len: 1267 microversion: 2.1 time: 0.156155 Oct 30 01:08:54.345430 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 610/1199] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:54 2022] GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:54.945068 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a1ea09c0-56b2-4061-a996-d2ceb3a4ee55 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:54.945611 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a1ea09c0-56b2-4061-a996-d2ceb3a4ee55 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:54.952671 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a1ea09c0-56b2-4061-a996-d2ceb3a4ee55 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:54.953142 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a1ea09c0-56b2-4061-a996-d2ceb3a4ee55 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:54.953575 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a1ea09c0-56b2-4061-a996-d2ceb3a4ee55 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:54.954262 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a1ea09c0-56b2-4061-a996-d2ceb3a4ee55 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:54.954714 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a1ea09c0-56b2-4061-a996-d2ceb3a4ee55 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:54.955140 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a1ea09c0-56b2-4061-a996-d2ceb3a4ee55 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:54.959095 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:08:55.095762 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a1ea09c0-56b2-4061-a996-d2ceb3a4ee55 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:55.104781 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a1ea09c0-56b2-4061-a996-d2ceb3a4ee55 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1757 microversion: 2.1 time: 0.163893 Oct 30 01:08:55.105351 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 590/1200] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:54 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:55.368054 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-fb701a27-5e0b-4d3f-b8f7-4888373bf3ae tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:55.368995 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-fb701a27-5e0b-4d3f-b8f7-4888373bf3ae tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:55.375257 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fb701a27-5e0b-4d3f-b8f7-4888373bf3ae tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:55.375860 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fb701a27-5e0b-4d3f-b8f7-4888373bf3ae tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:55.376340 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fb701a27-5e0b-4d3f-b8f7-4888373bf3ae tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:55.377095 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fb701a27-5e0b-4d3f-b8f7-4888373bf3ae tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:55.377546 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fb701a27-5e0b-4d3f-b8f7-4888373bf3ae tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:55.377973 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-fb701a27-5e0b-4d3f-b8f7-4888373bf3ae tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:55.513017 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-fb701a27-5e0b-4d3f-b8f7-4888373bf3ae tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:55.520894 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-fb701a27-5e0b-4d3f-b8f7-4888373bf3ae tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5" status: 200 len: 1455 microversion: 2.1 time: 0.156816 Oct 30 01:08:55.521444 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 611/1201] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:55 2022] GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:55.542952 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-30fa7e99-3af7-430f-976a-78a1702739f7 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:55.543587 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-30fa7e99-3af7-430f-976a-78a1702739f7 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:55.549454 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-30fa7e99-3af7-430f-976a-78a1702739f7 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:55.549931 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-30fa7e99-3af7-430f-976a-78a1702739f7 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:55.550375 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-30fa7e99-3af7-430f-976a-78a1702739f7 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:55.551061 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-30fa7e99-3af7-430f-976a-78a1702739f7 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:55.551514 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-30fa7e99-3af7-430f-976a-78a1702739f7 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:55.551965 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-30fa7e99-3af7-430f-976a-78a1702739f7 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:55.688856 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-30fa7e99-3af7-430f-976a-78a1702739f7 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:55.696968 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-30fa7e99-3af7-430f-976a-78a1702739f7 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5" status: 200 len: 1455 microversion: 2.1 time: 0.158134 Oct 30 01:08:55.697521 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 591/1202] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:55 2022] GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 => generated 1455 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:56.127800 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-6ac55a24-9150-4ce3-afda-22c5e72f34b1 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:56.128431 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-6ac55a24-9150-4ce3-afda-22c5e72f34b1 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:56.134431 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6ac55a24-9150-4ce3-afda-22c5e72f34b1 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:56.135374 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6ac55a24-9150-4ce3-afda-22c5e72f34b1 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:56.135976 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6ac55a24-9150-4ce3-afda-22c5e72f34b1 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:56.136704 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6ac55a24-9150-4ce3-afda-22c5e72f34b1 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:56.137146 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6ac55a24-9150-4ce3-afda-22c5e72f34b1 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:56.137563 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6ac55a24-9150-4ce3-afda-22c5e72f34b1 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:56.413674 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6ac55a24-9150-4ce3-afda-22c5e72f34b1 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:56.422926 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-6ac55a24-9150-4ce3-afda-22c5e72f34b1 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1757 microversion: 2.1 time: 0.298948 Oct 30 01:08:56.423482 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 612/1203] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:56 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1757 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:57.448292 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-ce0ce0d8-d711-4cbd-bc30-b8dc2ce14818 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:57.448904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-ce0ce0d8-d711-4cbd-bc30-b8dc2ce14818 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:57.454934 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ce0ce0d8-d711-4cbd-bc30-b8dc2ce14818 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:57.455406 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ce0ce0d8-d711-4cbd-bc30-b8dc2ce14818 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:57.455839 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ce0ce0d8-d711-4cbd-bc30-b8dc2ce14818 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:57.456570 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ce0ce0d8-d711-4cbd-bc30-b8dc2ce14818 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:57.457021 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ce0ce0d8-d711-4cbd-bc30-b8dc2ce14818 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:57.457523 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-ce0ce0d8-d711-4cbd-bc30-b8dc2ce14818 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:57.685767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-ce0ce0d8-d711-4cbd-bc30-b8dc2ce14818 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:57.694883 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-ce0ce0d8-d711-4cbd-bc30-b8dc2ce14818 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1757 microversion: 2.1 time: 0.251633 Oct 30 01:08:57.695690 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 592/1204] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:57 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1757 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:08:57.708336 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-91b97dad-fc45-4045-b856-cfba8f613054 req-632b8ca4-72d8-4061-967d-26fd90a248a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a96b858-272d-4c54-a3f4-e2d20a8ec7f5", "tag": "5baac346-1954-45fd-802a-77c919eb50ce"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:08:57.718957 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-91b97dad-fc45-4045-b856-cfba8f613054 req-632b8ca4-72d8-4061-967d-26fd90a248a3 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:57.719445 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-91b97dad-fc45-4045-b856-cfba8f613054 req-632b8ca4-72d8-4061-967d-26fd90a248a3 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:57.719876 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-91b97dad-fc45-4045-b856-cfba8f613054 req-632b8ca4-72d8-4061-967d-26fd90a248a3 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:57.723740 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=100 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:08:57.732619 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-91b97dad-fc45-4045-b856-cfba8f613054 req-632b8ca4-72d8-4061-967d-26fd90a248a3 service nova] Creating event network-changed:5baac346-1954-45fd-802a-77c919eb50ce for instance 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 on hv-cinder-86149 Oct 30 01:08:57.737640 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-91b97dad-fc45-4045-b856-cfba8f613054 req-632b8ca4-72d8-4061-967d-26fd90a248a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033006 Oct 30 01:08:57.738242 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 613/1205] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:08:58.719371 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-a9eb5042-3047-46db-ad56-f31b5dde7835 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:08:58.719978 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-a9eb5042-3047-46db-ad56-f31b5dde7835 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:08:58.726625 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9eb5042-3047-46db-ad56-f31b5dde7835 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:58.727111 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9eb5042-3047-46db-ad56-f31b5dde7835 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:58.727572 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9eb5042-3047-46db-ad56-f31b5dde7835 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:58.728385 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9eb5042-3047-46db-ad56-f31b5dde7835 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:08:58.728830 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9eb5042-3047-46db-ad56-f31b5dde7835 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:08:58.729453 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-a9eb5042-3047-46db-ad56-f31b5dde7835 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:08:58.887796 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-a9eb5042-3047-46db-ad56-f31b5dde7835 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:08:58.896335 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-a9eb5042-3047-46db-ad56-f31b5dde7835 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1760 microversion: 2.1 time: 0.181127 Oct 30 01:08:58.896899 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 593/1206] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:08:58 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1760 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:10:02.198012 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:10:02.204279 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2f736341-3920-4e4d-afea-a830d9b46e69 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1698629715"}} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:10:02.204904 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2f736341-3920-4e4d-afea-a830d9b46e69 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:02.212421 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2f736341-3920-4e4d-afea-a830d9b46e69 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:02.212931 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2f736341-3920-4e4d-afea-a830d9b46e69 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:02.213361 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2f736341-3920-4e4d-afea-a830d9b46e69 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:02.214053 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2f736341-3920-4e4d-afea-a830d9b46e69 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:02.214499 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2f736341-3920-4e4d-afea-a830d9b46e69 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:02.214911 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2f736341-3920-4e4d-afea-a830d9b46e69 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:02.383201 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.network.security_group_api [None req-2f736341-3920-4e4d-afea-a830d9b46e69 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Removing security group 5543d8b7-c435-494d-a3e7-aff76c7e9284 from port 2f2d3a7d-dcac-4dcb-a220-b51bd1719f54 Oct 30 01:10:02.729679 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2f736341-3920-4e4d-afea-a830d9b46e69 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "POST /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9/action" status: 202 len: 0 microversion: 2.1 time: 0.534396 Oct 30 01:10:02.730768 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 614/1207] 10.222.0.36 () {60 vars in 1278 bytes} [Sun Oct 30 01:10:02 2022] POST /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:10:02.739831 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:10:02.740563 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=22 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:10:02.742499 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 01:10:02.742736 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Sun Oct 30 01:10:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 30 01:10:02.744166 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 01:10:02.744337 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Sun Oct 30 01:10:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 30 01:10:02.755345 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-48b9f7d7-03ea-4c02-8c1e-a8f009b2f542 req-744effb7-74d0-405f-9609-879a1121a56f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9", "tag": "2f2d3a7d-dcac-4dcb-a220-b51bd1719f54"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:10:02.767569 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-48b9f7d7-03ea-4c02-8c1e-a8f009b2f542 req-744effb7-74d0-405f-9609-879a1121a56f service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:02.768254 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-48b9f7d7-03ea-4c02-8c1e-a8f009b2f542 req-744effb7-74d0-405f-9609-879a1121a56f service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:02.768813 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-48b9f7d7-03ea-4c02-8c1e-a8f009b2f542 req-744effb7-74d0-405f-9609-879a1121a56f service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:02.789910 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-48b9f7d7-03ea-4c02-8c1e-a8f009b2f542 req-744effb7-74d0-405f-9609-879a1121a56f service nova] Creating event network-changed:2f2d3a7d-dcac-4dcb-a220-b51bd1719f54 for instance 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 on hv-cinder-86149 Oct 30 01:10:02.796843 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-48b9f7d7-03ea-4c02-8c1e-a8f009b2f542 req-744effb7-74d0-405f-9609-879a1121a56f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058145 Oct 30 01:10:02.798600 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 594/1208] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:10:04.167633 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-a7a94187-6d78-4538-9dca-4f2227fa2be5 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:04.168261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-a7a94187-6d78-4538-9dca-4f2227fa2be5 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:04.177010 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a7a94187-6d78-4538-9dca-4f2227fa2be5 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:04.177661 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a7a94187-6d78-4538-9dca-4f2227fa2be5 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:04.178242 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a7a94187-6d78-4538-9dca-4f2227fa2be5 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:04.179080 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a7a94187-6d78-4538-9dca-4f2227fa2be5 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:04.179650 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a7a94187-6d78-4538-9dca-4f2227fa2be5 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:04.180236 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-a7a94187-6d78-4538-9dca-4f2227fa2be5 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:04.274829 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.objects.instance [None req-a7a94187-6d78-4538-9dca-4f2227fa2be5 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lazy-loading 'services' on Instance uuid 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 {{(pid=125554) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 30 01:10:04.359762 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-a7a94187-6d78-4538-9dca-4f2227fa2be5 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "DELETE /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9/os-volume_attachments/066b6cd5-c8ee-4dd7-a544-5b3705cd16f4" status: 202 len: 0 microversion: 2.1 time: 0.196390 Oct 30 01:10:04.363943 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 615/1209] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Oct 30 01:10:04 2022] DELETE /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9/os-volume_attachments/066b6cd5-c8ee-4dd7-a544-5b3705cd16f4 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:10:04.370668 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-73c32368-7b5a-4269-91c9-fb7b622e78a7 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:04.375864 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-73c32368-7b5a-4269-91c9-fb7b622e78a7 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:04.387514 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-73c32368-7b5a-4269-91c9-fb7b622e78a7 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:04.388827 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-73c32368-7b5a-4269-91c9-fb7b622e78a7 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:04.392378 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-73c32368-7b5a-4269-91c9-fb7b622e78a7 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:04.393640 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-73c32368-7b5a-4269-91c9-fb7b622e78a7 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:04.394215 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-73c32368-7b5a-4269-91c9-fb7b622e78a7 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:04.394733 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-73c32368-7b5a-4269-91c9-fb7b622e78a7 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:04.433326 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-73c32368-7b5a-4269-91c9-fb7b622e78a7 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067882 Oct 30 01:10:04.434001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 595/1210] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Oct 30 01:10:04 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:10:04.818091 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-6744747d-e0a9-4778-a4ab-b9770a9020dd req-e2d3c0a4-8ae3-41cf-8d31-bec4a351b10f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9", "tag": "2f2d3a7d-dcac-4dcb-a220-b51bd1719f54"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:10:04.829697 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-6744747d-e0a9-4778-a4ab-b9770a9020dd req-e2d3c0a4-8ae3-41cf-8d31-bec4a351b10f service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:04.830172 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-6744747d-e0a9-4778-a4ab-b9770a9020dd req-e2d3c0a4-8ae3-41cf-8d31-bec4a351b10f service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:04.830603 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-6744747d-e0a9-4778-a4ab-b9770a9020dd req-e2d3c0a4-8ae3-41cf-8d31-bec4a351b10f service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:04.841875 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-6744747d-e0a9-4778-a4ab-b9770a9020dd req-e2d3c0a4-8ae3-41cf-8d31-bec4a351b10f service nova] Creating event network-changed:2f2d3a7d-dcac-4dcb-a220-b51bd1719f54 for instance 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 on hv-cinder-86149 Oct 30 01:10:04.847086 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-6744747d-e0a9-4778-a4ab-b9770a9020dd req-e2d3c0a4-8ae3-41cf-8d31-bec4a351b10f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033864 Oct 30 01:10:04.847689 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 616/1211] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:10:05.447565 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c91c127a-b93e-4d0f-afaa-fb542e000844 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:05.450822 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-c91c127a-b93e-4d0f-afaa-fb542e000844 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:05.458001 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c91c127a-b93e-4d0f-afaa-fb542e000844 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:05.458574 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c91c127a-b93e-4d0f-afaa-fb542e000844 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:05.459071 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c91c127a-b93e-4d0f-afaa-fb542e000844 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:05.460008 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c91c127a-b93e-4d0f-afaa-fb542e000844 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:05.460519 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c91c127a-b93e-4d0f-afaa-fb542e000844 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:05.460944 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c91c127a-b93e-4d0f-afaa-fb542e000844 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:05.495724 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c91c127a-b93e-4d0f-afaa-fb542e000844 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052026 Oct 30 01:10:05.496445 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 596/1212] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Oct 30 01:10:05 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:10:06.509700 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-55877da9-0e6b-43f0-b882-219112d5ebc7 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:06.512010 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-55877da9-0e6b-43f0-b882-219112d5ebc7 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:06.519874 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55877da9-0e6b-43f0-b882-219112d5ebc7 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:06.520420 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55877da9-0e6b-43f0-b882-219112d5ebc7 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:06.520853 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55877da9-0e6b-43f0-b882-219112d5ebc7 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:06.521547 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55877da9-0e6b-43f0-b882-219112d5ebc7 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:06.521987 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55877da9-0e6b-43f0-b882-219112d5ebc7 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:06.522402 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-55877da9-0e6b-43f0-b882-219112d5ebc7 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:06.558224 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-55877da9-0e6b-43f0-b882-219112d5ebc7 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052839 Oct 30 01:10:06.558803 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 617/1213] 10.222.0.36 () {58 vars in 1302 bytes} [Sun Oct 30 01:10:06 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 30 01:10:06.571988 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-46af5e0b-14de-4c39-b576-2c255d3251b2 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:06.572608 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-46af5e0b-14de-4c39-b576-2c255d3251b2 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:06.578846 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-46af5e0b-14de-4c39-b576-2c255d3251b2 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:06.579332 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-46af5e0b-14de-4c39-b576-2c255d3251b2 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:06.579772 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-46af5e0b-14de-4c39-b576-2c255d3251b2 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:06.580538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-46af5e0b-14de-4c39-b576-2c255d3251b2 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:06.581026 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-46af5e0b-14de-4c39-b576-2c255d3251b2 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:06.588839 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-46af5e0b-14de-4c39-b576-2c255d3251b2 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:06.660799 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-46af5e0b-14de-4c39-b576-2c255d3251b2 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] HTTP exception thrown: Instance 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 is not attached to volume 066b6cd5-c8ee-4dd7-a544-5b3705cd16f4 Oct 30 01:10:06.663302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-46af5e0b-14de-4c39-b576-2c255d3251b2 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Request method failure captured: Oct 30 01:10:06.663302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: DELETE /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9/os-volume_attachments/066b6cd5-c8ee-4dd7-a544-5b3705cd16f4 HTTP/1.1 Oct 30 01:10:06.663302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 01:10:06.663302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 01:10:06.663302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 01:10:06.663302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 01:10:06.663302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 01:10:06.663302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 01:10:06.663302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 01:10:06.663302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 01:10:06.663302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXc4skmBmbpHfs0IPtMBHmN4CmZYnui3ELuKd-FmdEn8Og3wAHo7rBJoDupsxp_d7KzErQizyHZETRGrwPwLgwXwF33m_5-XStGmyUGXx-PoE5z-PCC6EbITUJJZPGcsK9voHIGzSiormZQaqhFQtSJ2khD7_WRmj3MEAue7EsH8RyMc Oct 30 01:10:06.663302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 01:10:06.663302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 01:10:06.663302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 01:10:06.663302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 01:10:06.663302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 01:10:06.663302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 01:10:06.663302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: 4012d80a074641cc80074df4f602d9f0 Oct 30 01:10:06.663302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-TestMinimumBasicScenario-814953516 Oct 30 01:10:06.663302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 01:10:06.663302 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 01:10:06.665169 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4012d80a074641cc80074df4f602d9f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4012d80a074641cc80074df4f602d9f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4012d80a074641cc80074df4f602d9f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4012d80a074641cc80074df4f602d9f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:10:06.665169 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-TestMinimumBasicScenario-814953516 Oct 30 01:10:06.665169 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: 4012d80a074641cc80074df4f602d9f0 Oct 30 01:10:06.665169 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-TestMinimumBasicScenario-814953516 Oct 30 01:10:06.665169 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-TestMinimumBasicScenario-814953516-project Oct 30 01:10:06.665169 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 01:10:06.665169 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 01:10:06.665169 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: 578ca2679aa44174b912eb70339373cb Oct 30 01:10:06.665169 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-TestMinimumBasicScenario-814953516-project Oct 30 01:10:06.665169 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: > Oct 30 01:10:06.665169 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Instance 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 is not attached to volume 066b6cd5-c8ee-4dd7-a544-5b3705cd16f4 Oct 30 01:10:06.666217 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'server_id': '92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9', 'id': '066b6cd5-c8ee-4dd7-a544-5b3705cd16f4'} Oct 30 01:10:06.666217 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:10:06.666217 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:10:06.666217 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 30 01:10:06.666217 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 30 01:10:06.666217 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 30 01:10:06.666217 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 30 01:10:06.666217 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 30 01:10:06.666217 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 30 01:10:06.666217 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 066b6cd5-c8ee-4dd7-a544-5b3705cd16f4. Oct 30 01:10:06.666217 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:10:06.666217 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:10:06.666217 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:10:06.666217 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:10:06.666217 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:10:06.666217 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:10:06.666217 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:10:06.666217 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:10:06.666217 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:10:06.668157 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:10:06.668157 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 30 01:10:06.668157 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 30 01:10:06.668157 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 is not attached to volume 066b6cd5-c8ee-4dd7-a544-5b3705cd16f4 Oct 30 01:10:06.668157 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:10:06.668157 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:10:06.668157 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:10:06.668157 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:10:06.668157 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:10:06.668157 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:10:06.668157 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:10:06.668157 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:10:06.668157 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 is not attached to volume 066b6cd5-c8ee-4dd7-a544-5b3705cd16f4 Oct 30 01:10:06.668157 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:10:06.668157 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-46af5e0b-14de-4c39-b576-2c255d3251b2 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Returning 404 to user: Instance 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 is not attached to volume 066b6cd5-c8ee-4dd7-a544-5b3705cd16f4 {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:10:06.669447 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-46af5e0b-14de-4c39-b576-2c255d3251b2 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "DELETE /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9/os-volume_attachments/066b6cd5-c8ee-4dd7-a544-5b3705cd16f4" status: 404 len: 154 microversion: 2.1 time: 0.098318 Oct 30 01:10:06.669447 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 597/1214] 10.222.0.36 () {58 vars in 1416 bytes} [Sun Oct 30 01:10:06 2022] DELETE /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9/os-volume_attachments/066b6cd5-c8ee-4dd7-a544-5b3705cd16f4 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:10:07.811211 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-f0adb793-ea8e-4f80-b2d7-1f543383dcac tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:07.812290 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-f0adb793-ea8e-4f80-b2d7-1f543383dcac tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:07.819190 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f0adb793-ea8e-4f80-b2d7-1f543383dcac tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:07.819669 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f0adb793-ea8e-4f80-b2d7-1f543383dcac tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:07.820118 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f0adb793-ea8e-4f80-b2d7-1f543383dcac tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:07.820843 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f0adb793-ea8e-4f80-b2d7-1f543383dcac tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:07.821658 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f0adb793-ea8e-4f80-b2d7-1f543383dcac tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:07.822086 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-f0adb793-ea8e-4f80-b2d7-1f543383dcac tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:07.848587 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-f0adb793-ea8e-4f80-b2d7-1f543383dcac tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Going to try to terminate instance {{(pid=125554) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:10:07.928984 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-f0adb793-ea8e-4f80-b2d7-1f543383dcac tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "DELETE /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 204 len: 0 microversion: 2.1 time: 0.121233 Oct 30 01:10:07.929880 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 618/1215] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 01:10:07 2022] DELETE /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:10:07.938556 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c0ee2338-33da-4349-adcf-e86da4858915 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:07.939349 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-c0ee2338-33da-4349-adcf-e86da4858915 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:07.945909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c0ee2338-33da-4349-adcf-e86da4858915 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:07.946389 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c0ee2338-33da-4349-adcf-e86da4858915 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:07.946822 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c0ee2338-33da-4349-adcf-e86da4858915 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:07.947519 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c0ee2338-33da-4349-adcf-e86da4858915 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:07.947972 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c0ee2338-33da-4349-adcf-e86da4858915 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:07.948427 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c0ee2338-33da-4349-adcf-e86da4858915 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:08.085213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c0ee2338-33da-4349-adcf-e86da4858915 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:08.093762 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c0ee2338-33da-4349-adcf-e86da4858915 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1554 microversion: 2.1 time: 0.159019 Oct 30 01:10:08.094344 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 598/1216] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:07 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:09.119234 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-c57bec3b-6b36-4c12-b5b1-d08b983b93b8 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:09.119835 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-c57bec3b-6b36-4c12-b5b1-d08b983b93b8 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:09.126432 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c57bec3b-6b36-4c12-b5b1-d08b983b93b8 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:09.126911 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c57bec3b-6b36-4c12-b5b1-d08b983b93b8 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:09.127343 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c57bec3b-6b36-4c12-b5b1-d08b983b93b8 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:09.128042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c57bec3b-6b36-4c12-b5b1-d08b983b93b8 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:09.128526 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c57bec3b-6b36-4c12-b5b1-d08b983b93b8 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:09.128945 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-c57bec3b-6b36-4c12-b5b1-d08b983b93b8 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:09.262348 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-c57bec3b-6b36-4c12-b5b1-d08b983b93b8 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:09.270663 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-c57bec3b-6b36-4c12-b5b1-d08b983b93b8 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1554 microversion: 2.1 time: 0.156667 Oct 30 01:10:09.271344 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 619/1217] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:09 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:10.294151 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-0f752c0f-5e9f-4c0f-915e-4aa5f24247d9 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:10.294893 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-0f752c0f-5e9f-4c0f-915e-4aa5f24247d9 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:10.302312 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0f752c0f-5e9f-4c0f-915e-4aa5f24247d9 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:10.302897 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0f752c0f-5e9f-4c0f-915e-4aa5f24247d9 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:10.303333 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0f752c0f-5e9f-4c0f-915e-4aa5f24247d9 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:10.304037 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0f752c0f-5e9f-4c0f-915e-4aa5f24247d9 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:10.304524 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0f752c0f-5e9f-4c0f-915e-4aa5f24247d9 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:10.304945 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-0f752c0f-5e9f-4c0f-915e-4aa5f24247d9 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:10.445254 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-0f752c0f-5e9f-4c0f-915e-4aa5f24247d9 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '578ca2679aa44174b912eb70339373cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4012d80a074641cc80074df4f602d9f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:10.453616 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-0f752c0f-5e9f-4c0f-915e-4aa5f24247d9 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 200 len: 1554 microversion: 2.1 time: 0.163234 Oct 30 01:10:10.454105 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 599/1218] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:10 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:10.635317 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-803cb9be-a1b9-4423-b4c5-39b23b2d3ef7 req-4d7bb544-e13f-4b7d-bb75-2261fcd367a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9", "name": "network-vif-deleted", "tag": "2f2d3a7d-dcac-4dcb-a220-b51bd1719f54"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:10:10.646582 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-803cb9be-a1b9-4423-b4c5-39b23b2d3ef7 req-4d7bb544-e13f-4b7d-bb75-2261fcd367a0 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:10.647065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-803cb9be-a1b9-4423-b4c5-39b23b2d3ef7 req-4d7bb544-e13f-4b7d-bb75-2261fcd367a0 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:10.647510 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-803cb9be-a1b9-4423-b4c5-39b23b2d3ef7 req-4d7bb544-e13f-4b7d-bb75-2261fcd367a0 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:10.663229 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-803cb9be-a1b9-4423-b4c5-39b23b2d3ef7 req-4d7bb544-e13f-4b7d-bb75-2261fcd367a0 service nova] Creating event network-vif-deleted:2f2d3a7d-dcac-4dcb-a220-b51bd1719f54 for instance 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 on hv-cinder-86149 Oct 30 01:10:10.674940 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-803cb9be-a1b9-4423-b4c5-39b23b2d3ef7 req-4d7bb544-e13f-4b7d-bb75-2261fcd367a0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043060 Oct 30 01:10:10.675688 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 620/1219] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:10:11.477733 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c7cbe221-46f9-4238-bdb2-74f922ce026b tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:11.478355 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-c7cbe221-46f9-4238-bdb2-74f922ce026b tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] [instance: 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:11.485416 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c7cbe221-46f9-4238-bdb2-74f922ce026b tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:11.485899 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c7cbe221-46f9-4238-bdb2-74f922ce026b tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:11.486327 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c7cbe221-46f9-4238-bdb2-74f922ce026b tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:11.487114 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c7cbe221-46f9-4238-bdb2-74f922ce026b tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:11.487460 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c7cbe221-46f9-4238-bdb2-74f922ce026b tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:11.487874 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c7cbe221-46f9-4238-bdb2-74f922ce026b tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:11.504787 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-c7cbe221-46f9-4238-bdb2-74f922ce026b tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] HTTP exception thrown: Instance 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 could not be found. Oct 30 01:10:11.506321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c7cbe221-46f9-4238-bdb2-74f922ce026b tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Request method failure captured: Oct 30 01:10:11.506321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 HTTP/1.1 Oct 30 01:10:11.506321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 01:10:11.506321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 01:10:11.506321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 01:10:11.506321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 01:10:11.506321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 01:10:11.506321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 01:10:11.506321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 01:10:11.506321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 01:10:11.506321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXc4skmBmbpHfs0IPtMBHmN4CmZYnui3ELuKd-FmdEn8Og3wAHo7rBJoDupsxp_d7KzErQizyHZETRGrwPwLgwXwF33m_5-XStGmyUGXx-PoE5z-PCC6EbITUJJZPGcsK9voHIGzSiormZQaqhFQtSJ2khD7_WRmj3MEAue7EsH8RyMc Oct 30 01:10:11.506321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 01:10:11.506321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 01:10:11.506321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 01:10:11.506321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 01:10:11.506321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 01:10:11.506321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 01:10:11.506321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: 4012d80a074641cc80074df4f602d9f0 Oct 30 01:10:11.506321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-TestMinimumBasicScenario-814953516 Oct 30 01:10:11.506321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 01:10:11.506321 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 01:10:11.507848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4012d80a074641cc80074df4f602d9f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4012d80a074641cc80074df4f602d9f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4012d80a074641cc80074df4f602d9f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4012d80a074641cc80074df4f602d9f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:10:11.507848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-TestMinimumBasicScenario-814953516 Oct 30 01:10:11.507848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: 4012d80a074641cc80074df4f602d9f0 Oct 30 01:10:11.507848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-TestMinimumBasicScenario-814953516 Oct 30 01:10:11.507848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-TestMinimumBasicScenario-814953516-project Oct 30 01:10:11.507848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 01:10:11.507848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 01:10:11.507848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: 578ca2679aa44174b912eb70339373cb Oct 30 01:10:11.507848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-TestMinimumBasicScenario-814953516-project Oct 30 01:10:11.507848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: > Oct 30 01:10:11.507848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Instance 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 could not be found. Oct 30 01:10:11.507848 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': '92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9'} Oct 30 01:10:11.508749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:10:11.508749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:10:11.508749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:10:11.508749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:10:11.508749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:10:11.508749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:10:11.508749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:10:11.508749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:10:11.508749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:10:11.508749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:10:11.508749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 could not be found. Oct 30 01:10:11.508749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:10:11.508749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:10:11.508749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:10:11.508749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:10:11.508749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:10:11.508749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:10:11.508749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:10:11.508749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:10:11.508749 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:10:11.510439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:10:11.510439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:10:11.510439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:10:11.510439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:10:11.510439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:10:11.510439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:10:11.510439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:10:11.510439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 could not be found. Oct 30 01:10:11.510439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:10:11.510439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:10:11.510439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:10:11.510439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:10:11.510439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:10:11.510439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:10:11.510439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:10:11.510439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:10:11.510439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 could not be found. Oct 30 01:10:11.510439 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:10:11.512152 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c7cbe221-46f9-4238-bdb2-74f922ce026b tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Returning 404 to user: Instance 92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:10:11.512152 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c7cbe221-46f9-4238-bdb2-74f922ce026b tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9" status: 404 len: 111 microversion: 2.1 time: 0.034142 Oct 30 01:10:11.512152 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 600/1220] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:11 2022] GET /compute/v2.1/servers/92b5cd96-24d1-42c7-b6ed-e2cc2033ffa9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:10:11.517946 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-65b893a2-8092-4a73-88a2-d75c7c3b9ad5 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] Calling method '.version_select at 0x7faf7676b4c0>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:11.540522 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-65b893a2-8092-4a73-88a2-d75c7c3b9ad5 tempest-TestMinimumBasicScenario-814953516 tempest-TestMinimumBasicScenario-814953516-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-278444165" status: 202 len: 0 microversion: 2.1 time: 0.027358 Oct 30 01:10:11.541093 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 621/1221] 10.222.0.36 () {58 vars in 1269 bytes} [Sun Oct 30 01:10:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-278444165 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 30 01:10:58.010590 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-5f3eb1a7-1463-474e-822b-7cdc47572994 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1457460482", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1905451183", "security_groups": [{"name": "tempest-secgroup-smoke-1393638939"}], "block_device_mapping_v2": [{"uuid": "6174e476-d900-477a-8e93-75beee4ba5d1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e079eebe-8fcb-409d-9370-b9e72d108471"}]}} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:10:58.021060 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=14 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:10:58.021707 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=34 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:10:58.130191 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.network.neutron [None req-5f3eb1a7-1463-474e-822b-7cdc47572994 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] validate_networks() for [('e079eebe-8fcb-409d-9370-b9e72d108471', None, None, None, None, None)] {{(pid=125553) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 30 01:10:58.631531 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-5f3eb1a7-1463-474e-822b-7cdc47572994 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Flavor limits 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 30 01:10:58.631949 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-5f3eb1a7-1463-474e-822b-7cdc47572994 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Image limits 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 30 01:10:58.632464 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-5f3eb1a7-1463-474e-822b-7cdc47572994 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Flavor pref 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 30 01:10:58.632872 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-5f3eb1a7-1463-474e-822b-7cdc47572994 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Image pref 0:0:0 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 30 01:10:58.633286 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.virt.hardware [None req-5f3eb1a7-1463-474e-822b-7cdc47572994 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 30 01:10:58.642899 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5f3eb1a7-1463-474e-822b-7cdc47572994 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:58.643375 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5f3eb1a7-1463-474e-822b-7cdc47572994 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:58.643807 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5f3eb1a7-1463-474e-822b-7cdc47572994 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:58.644572 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5f3eb1a7-1463-474e-822b-7cdc47572994 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:58.645024 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5f3eb1a7-1463-474e-822b-7cdc47572994 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:58.645445 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-5f3eb1a7-1463-474e-822b-7cdc47572994 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:58.662632 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-5f3eb1a7-1463-474e-822b-7cdc47572994 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Getting quotas for project a8a24adf04bb4adfbc7347a5e4ec6b52. Resources: {'instances', 'cores', 'ram'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 30 01:10:58.667761 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.quota [None req-5f3eb1a7-1463-474e-822b-7cdc47572994 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Getting quotas for user d6d3fe4f3fbb4dedb7a0703a2bb6884d and project a8a24adf04bb4adfbc7347a5e4ec6b52. Resources: {'instances', 'cores', 'ram'} {{(pid=125553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 30 01:10:58.731572 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5f3eb1a7-1463-474e-822b-7cdc47572994 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Going to run 1 instances... {{(pid=125553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 30 01:10:58.733733 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-5f3eb1a7-1463-474e-822b-7cdc47572994 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6174e476-d900-477a-8e93-75beee4ba5d1',volume_size=None,volume_type=None)] {{(pid=125553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 30 01:10:58.877841 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-5f3eb1a7-1463-474e-822b-7cdc47572994 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.871247 Oct 30 01:10:58.878704 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 601/1222] 10.222.0.36 () {60 vars in 1147 bytes} [Sun Oct 30 01:10:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 30 01:10:58.887683 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:10:58.888483 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:10:58.893426 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-5181fd39-0871-4d54-ae7f-0f0aec2a04ab tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:58.894166 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-5181fd39-0871-4d54-ae7f-0f0aec2a04ab tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:58.957214 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-5181fd39-0871-4d54-ae7f-0f0aec2a04ab tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:10:58.966785 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-5181fd39-0871-4d54-ae7f-0f0aec2a04ab tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb" status: 200 len: 1095 microversion: 2.1 time: 0.080679 Oct 30 01:10:58.967355 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 622/1223] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:58 2022] GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:10:59.990588 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-cd242adb-3827-46f7-9f36-b3c7864bb542 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:10:59.991213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-cd242adb-3827-46f7-9f36-b3c7864bb542 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:10:59.998125 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd242adb-3827-46f7-9f36-b3c7864bb542 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:10:59.998632 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd242adb-3827-46f7-9f36-b3c7864bb542 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:10:59.999099 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd242adb-3827-46f7-9f36-b3c7864bb542 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:10:59.999811 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd242adb-3827-46f7-9f36-b3c7864bb542 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:00.000307 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd242adb-3827-46f7-9f36-b3c7864bb542 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:00.001280 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-cd242adb-3827-46f7-9f36-b3c7864bb542 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:00.067040 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-cd242adb-3827-46f7-9f36-b3c7864bb542 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:00.081346 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-cd242adb-3827-46f7-9f36-b3c7864bb542 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb" status: 200 len: 1193 microversion: 2.1 time: 0.094837 Oct 30 01:11:00.082410 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 602/1224] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:10:59 2022] GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb => generated 1193 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:01.117857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-8a28290c-deca-4ec7-b1d5-591fec26d4b1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:01.118453 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-8a28290c-deca-4ec7-b1d5-591fec26d4b1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:01.125613 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8a28290c-deca-4ec7-b1d5-591fec26d4b1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:01.126359 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8a28290c-deca-4ec7-b1d5-591fec26d4b1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:01.127050 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8a28290c-deca-4ec7-b1d5-591fec26d4b1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:01.127793 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8a28290c-deca-4ec7-b1d5-591fec26d4b1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:01.127793 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8a28290c-deca-4ec7-b1d5-591fec26d4b1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:01.127793 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-8a28290c-deca-4ec7-b1d5-591fec26d4b1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:01.277983 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-8a28290c-deca-4ec7-b1d5-591fec26d4b1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:01.286540 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-8a28290c-deca-4ec7-b1d5-591fec26d4b1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb" status: 200 len: 1267 microversion: 2.1 time: 0.172549 Oct 30 01:11:01.287110 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 623/1225] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:01 2022] GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:01.787777 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-45b4b447-6b18-4dbc-bb8f-c87717c2a27a req-45f2a09f-42b6-4156-a252-849a921d8823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eff06cea-0743-4940-be64-49f2fe7690bb", "tag": "bed349be-cd91-4758-afdf-c74830850515"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:11:01.797665 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-45b4b447-6b18-4dbc-bb8f-c87717c2a27a req-45f2a09f-42b6-4156-a252-849a921d8823 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:01.798141 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-45b4b447-6b18-4dbc-bb8f-c87717c2a27a req-45f2a09f-42b6-4156-a252-849a921d8823 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:01.798677 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-45b4b447-6b18-4dbc-bb8f-c87717c2a27a req-45f2a09f-42b6-4156-a252-849a921d8823 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:01.810126 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-45b4b447-6b18-4dbc-bb8f-c87717c2a27a req-45f2a09f-42b6-4156-a252-849a921d8823 service nova] Creating event network-changed:bed349be-cd91-4758-afdf-c74830850515 for instance eff06cea-0743-4940-be64-49f2fe7690bb on hv-cinder-86149 Oct 30 01:11:01.815389 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-45b4b447-6b18-4dbc-bb8f-c87717c2a27a req-45f2a09f-42b6-4156-a252-849a921d8823 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182758 Oct 30 01:11:01.815991 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 603/1226] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:11:02.315866 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-1588ce84-a717-45d2-8883-f79ece4e5e14 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:02.317018 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-1588ce84-a717-45d2-8883-f79ece4e5e14 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:02.329325 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1588ce84-a717-45d2-8883-f79ece4e5e14 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:02.330088 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1588ce84-a717-45d2-8883-f79ece4e5e14 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:02.330771 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1588ce84-a717-45d2-8883-f79ece4e5e14 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:02.331914 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1588ce84-a717-45d2-8883-f79ece4e5e14 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:02.332711 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1588ce84-a717-45d2-8883-f79ece4e5e14 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:02.334173 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-1588ce84-a717-45d2-8883-f79ece4e5e14 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:02.496389 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-1588ce84-a717-45d2-8883-f79ece4e5e14 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:02.504571 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-1588ce84-a717-45d2-8883-f79ece4e5e14 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb" status: 200 len: 1267 microversion: 2.1 time: 0.196516 Oct 30 01:11:02.505151 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 624/1227] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:02 2022] GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:03.530254 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-d1c76c43-600e-4c4a-86d7-6c3206b6961b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:03.530975 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-d1c76c43-600e-4c4a-86d7-6c3206b6961b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:03.538773 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d1c76c43-600e-4c4a-86d7-6c3206b6961b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:03.539289 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d1c76c43-600e-4c4a-86d7-6c3206b6961b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:03.539717 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d1c76c43-600e-4c4a-86d7-6c3206b6961b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:03.540459 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d1c76c43-600e-4c4a-86d7-6c3206b6961b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:03.540910 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d1c76c43-600e-4c4a-86d7-6c3206b6961b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:03.541326 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-d1c76c43-600e-4c4a-86d7-6c3206b6961b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:03.701354 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-d1c76c43-600e-4c4a-86d7-6c3206b6961b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:03.709497 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-d1c76c43-600e-4c4a-86d7-6c3206b6961b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb" status: 200 len: 1267 microversion: 2.1 time: 0.184143 Oct 30 01:11:03.710109 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 604/1228] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:03 2022] GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:04.733227 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-7386796c-95f9-4776-82f3-829b7deb26bd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:04.733841 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-7386796c-95f9-4776-82f3-829b7deb26bd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:04.742006 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7386796c-95f9-4776-82f3-829b7deb26bd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:04.742488 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7386796c-95f9-4776-82f3-829b7deb26bd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:04.742920 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7386796c-95f9-4776-82f3-829b7deb26bd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:04.743617 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7386796c-95f9-4776-82f3-829b7deb26bd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:04.744066 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7386796c-95f9-4776-82f3-829b7deb26bd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:04.744506 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-7386796c-95f9-4776-82f3-829b7deb26bd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:04.880731 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-7386796c-95f9-4776-82f3-829b7deb26bd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:04.889654 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-7386796c-95f9-4776-82f3-829b7deb26bd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb" status: 200 len: 1267 microversion: 2.1 time: 0.160279 Oct 30 01:11:04.890350 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 625/1229] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:04 2022] GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:05.912893 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-464075a8-81ea-401a-a3e6-62f645a0616d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:05.913501 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-464075a8-81ea-401a-a3e6-62f645a0616d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:05.919667 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-464075a8-81ea-401a-a3e6-62f645a0616d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:05.920182 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-464075a8-81ea-401a-a3e6-62f645a0616d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:05.920620 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-464075a8-81ea-401a-a3e6-62f645a0616d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:05.921311 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-464075a8-81ea-401a-a3e6-62f645a0616d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:05.921762 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-464075a8-81ea-401a-a3e6-62f645a0616d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:05.922188 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-464075a8-81ea-401a-a3e6-62f645a0616d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:06.056821 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-464075a8-81ea-401a-a3e6-62f645a0616d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:06.065197 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-464075a8-81ea-401a-a3e6-62f645a0616d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb" status: 200 len: 1267 microversion: 2.1 time: 0.156138 Oct 30 01:11:06.065945 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 605/1230] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:05 2022] GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:07.088846 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-9e0549d6-dc9d-4301-9588-18b6e9c5f10f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:07.089483 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-9e0549d6-dc9d-4301-9588-18b6e9c5f10f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:07.096837 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9e0549d6-dc9d-4301-9588-18b6e9c5f10f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:07.097318 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9e0549d6-dc9d-4301-9588-18b6e9c5f10f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:07.097749 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9e0549d6-dc9d-4301-9588-18b6e9c5f10f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:07.098445 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9e0549d6-dc9d-4301-9588-18b6e9c5f10f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:07.098890 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9e0549d6-dc9d-4301-9588-18b6e9c5f10f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:07.099303 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9e0549d6-dc9d-4301-9588-18b6e9c5f10f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:07.240522 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-9e0549d6-dc9d-4301-9588-18b6e9c5f10f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:07.248446 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-9e0549d6-dc9d-4301-9588-18b6e9c5f10f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb" status: 200 len: 1267 microversion: 2.1 time: 0.163416 Oct 30 01:11:07.249028 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 626/1231] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:07 2022] GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:08.272359 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-c20821e0-216c-4b70-b3e4-182c60411af6 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:08.273004 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-c20821e0-216c-4b70-b3e4-182c60411af6 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:08.279756 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c20821e0-216c-4b70-b3e4-182c60411af6 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:08.280273 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c20821e0-216c-4b70-b3e4-182c60411af6 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:08.280706 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c20821e0-216c-4b70-b3e4-182c60411af6 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:08.281403 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c20821e0-216c-4b70-b3e4-182c60411af6 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:08.282342 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c20821e0-216c-4b70-b3e4-182c60411af6 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:08.282766 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-c20821e0-216c-4b70-b3e4-182c60411af6 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:08.426907 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-c20821e0-216c-4b70-b3e4-182c60411af6 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:08.435014 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-c20821e0-216c-4b70-b3e4-182c60411af6 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb" status: 200 len: 1267 microversion: 2.1 time: 0.166537 Oct 30 01:11:08.435585 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 606/1232] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:08 2022] GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:09.459634 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-31a11287-4e21-4e8a-849e-181a53321e5d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:09.460287 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-31a11287-4e21-4e8a-849e-181a53321e5d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:09.462632 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell0:SELECT=2 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:09.467876 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-31a11287-4e21-4e8a-849e-181a53321e5d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:09.468397 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-31a11287-4e21-4e8a-849e-181a53321e5d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:09.468820 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-31a11287-4e21-4e8a-849e-181a53321e5d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:09.470179 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-31a11287-4e21-4e8a-849e-181a53321e5d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:09.470898 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-31a11287-4e21-4e8a-849e-181a53321e5d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:09.471403 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-31a11287-4e21-4e8a-849e-181a53321e5d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:09.615160 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-31a11287-4e21-4e8a-849e-181a53321e5d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:09.623091 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-31a11287-4e21-4e8a-849e-181a53321e5d tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb" status: 200 len: 1267 microversion: 2.1 time: 0.167301 Oct 30 01:11:09.623664 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 627/1233] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:09 2022] GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:10.647572 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-904012d2-18ae-4cb8-a02a-d65580cdcdf1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:10.648196 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-904012d2-18ae-4cb8-a02a-d65580cdcdf1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:10.650178 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=2 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:10.650989 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell0:SELECT=6 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:11:10.658306 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-904012d2-18ae-4cb8-a02a-d65580cdcdf1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:10.658800 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-904012d2-18ae-4cb8-a02a-d65580cdcdf1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:10.659229 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-904012d2-18ae-4cb8-a02a-d65580cdcdf1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:10.659935 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-904012d2-18ae-4cb8-a02a-d65580cdcdf1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:10.660425 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-904012d2-18ae-4cb8-a02a-d65580cdcdf1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:10.660846 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-904012d2-18ae-4cb8-a02a-d65580cdcdf1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:10.799832 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-904012d2-18ae-4cb8-a02a-d65580cdcdf1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:10.808012 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-904012d2-18ae-4cb8-a02a-d65580cdcdf1 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb" status: 200 len: 1267 microversion: 2.1 time: 0.164227 Oct 30 01:11:10.808700 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 607/1234] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:10 2022] GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:11.832838 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-d6c1da1b-fb0a-4487-87a8-26263e512b4f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:11.833446 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-d6c1da1b-fb0a-4487-87a8-26263e512b4f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:11.840049 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d6c1da1b-fb0a-4487-87a8-26263e512b4f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:11.840559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d6c1da1b-fb0a-4487-87a8-26263e512b4f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:11.840994 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d6c1da1b-fb0a-4487-87a8-26263e512b4f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:11.841696 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d6c1da1b-fb0a-4487-87a8-26263e512b4f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:11.842146 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d6c1da1b-fb0a-4487-87a8-26263e512b4f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:11.842567 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-d6c1da1b-fb0a-4487-87a8-26263e512b4f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:11.983198 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-d6c1da1b-fb0a-4487-87a8-26263e512b4f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:11.992283 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-d6c1da1b-fb0a-4487-87a8-26263e512b4f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb" status: 200 len: 1267 microversion: 2.1 time: 0.163242 Oct 30 01:11:11.992283 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 628/1235] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:11 2022] GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:13.015648 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-041faf03-0867-4ddb-b6d8-54672bc8c675 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:13.016957 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-041faf03-0867-4ddb-b6d8-54672bc8c675 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:13.023531 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-041faf03-0867-4ddb-b6d8-54672bc8c675 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:13.024016 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-041faf03-0867-4ddb-b6d8-54672bc8c675 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:13.024499 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-041faf03-0867-4ddb-b6d8-54672bc8c675 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:13.025205 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-041faf03-0867-4ddb-b6d8-54672bc8c675 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:13.025664 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-041faf03-0867-4ddb-b6d8-54672bc8c675 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:13.026094 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-041faf03-0867-4ddb-b6d8-54672bc8c675 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:13.162805 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-041faf03-0867-4ddb-b6d8-54672bc8c675 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:13.170909 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-041faf03-0867-4ddb-b6d8-54672bc8c675 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb" status: 200 len: 1267 microversion: 2.1 time: 0.159140 Oct 30 01:11:13.171477 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 608/1236] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:13 2022] GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:14.194811 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-5b7da063-aab0-4f92-ac7a-b52caad59cfd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:14.195465 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-5b7da063-aab0-4f92-ac7a-b52caad59cfd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:14.208363 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5b7da063-aab0-4f92-ac7a-b52caad59cfd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:14.208857 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5b7da063-aab0-4f92-ac7a-b52caad59cfd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:14.209291 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5b7da063-aab0-4f92-ac7a-b52caad59cfd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:14.210004 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5b7da063-aab0-4f92-ac7a-b52caad59cfd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:14.210496 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5b7da063-aab0-4f92-ac7a-b52caad59cfd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:14.210950 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-5b7da063-aab0-4f92-ac7a-b52caad59cfd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:14.278435 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-008851df-5283-4a96-8ffa-536beabbc4e9 req-866aa960-8910-44c5-a6ab-44935e1e033b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff06cea-0743-4940-be64-49f2fe7690bb", "name": "network-vif-plugged", "status": "completed", "tag": "bed349be-cd91-4758-afdf-c74830850515"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:11:14.289910 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-008851df-5283-4a96-8ffa-536beabbc4e9 req-866aa960-8910-44c5-a6ab-44935e1e033b service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:14.290392 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-008851df-5283-4a96-8ffa-536beabbc4e9 req-866aa960-8910-44c5-a6ab-44935e1e033b service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:14.290812 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-008851df-5283-4a96-8ffa-536beabbc4e9 req-866aa960-8910-44c5-a6ab-44935e1e033b service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:14.305722 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-008851df-5283-4a96-8ffa-536beabbc4e9 req-866aa960-8910-44c5-a6ab-44935e1e033b service nova] Creating event network-vif-plugged:bed349be-cd91-4758-afdf-c74830850515 for instance eff06cea-0743-4940-be64-49f2fe7690bb on hv-cinder-86149 Oct 30 01:11:14.309887 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-008851df-5283-4a96-8ffa-536beabbc4e9 req-866aa960-8910-44c5-a6ab-44935e1e033b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111056 Oct 30 01:11:14.310554 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 609/1237] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:11:14.364291 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-5b7da063-aab0-4f92-ac7a-b52caad59cfd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:14.377825 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-5b7da063-aab0-4f92-ac7a-b52caad59cfd tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb" status: 200 len: 1267 microversion: 2.1 time: 0.187250 Oct 30 01:11:14.378360 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 629/1238] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:14 2022] GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:15.402199 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-40e4c0a8-c3bf-4dc6-b273-63b1a922165f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:15.402896 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-40e4c0a8-c3bf-4dc6-b273-63b1a922165f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:15.410013 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-40e4c0a8-c3bf-4dc6-b273-63b1a922165f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:15.410536 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-40e4c0a8-c3bf-4dc6-b273-63b1a922165f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:15.411158 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-40e4c0a8-c3bf-4dc6-b273-63b1a922165f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:15.411942 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-40e4c0a8-c3bf-4dc6-b273-63b1a922165f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:15.412496 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-40e4c0a8-c3bf-4dc6-b273-63b1a922165f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:15.412973 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-40e4c0a8-c3bf-4dc6-b273-63b1a922165f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:15.567897 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-40e4c0a8-c3bf-4dc6-b273-63b1a922165f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:15.575286 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-40e4c0a8-c3bf-4dc6-b273-63b1a922165f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb" status: 200 len: 1267 microversion: 2.1 time: 0.177733 Oct 30 01:11:15.575861 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 610/1239] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:15 2022] GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:16.602593 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-0efbb508-42f3-4b22-b7ea-d3a34041a29e tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:16.603220 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-0efbb508-42f3-4b22-b7ea-d3a34041a29e tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:16.610120 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0efbb508-42f3-4b22-b7ea-d3a34041a29e tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:16.611129 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0efbb508-42f3-4b22-b7ea-d3a34041a29e tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:16.611562 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0efbb508-42f3-4b22-b7ea-d3a34041a29e tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:16.612293 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0efbb508-42f3-4b22-b7ea-d3a34041a29e tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:16.612738 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0efbb508-42f3-4b22-b7ea-d3a34041a29e tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:16.613157 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-0efbb508-42f3-4b22-b7ea-d3a34041a29e tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:16.754800 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-0efbb508-42f3-4b22-b7ea-d3a34041a29e tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:16.762733 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-0efbb508-42f3-4b22-b7ea-d3a34041a29e tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb" status: 200 len: 1454 microversion: 2.1 time: 0.164041 Oct 30 01:11:16.763337 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 630/1240] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:16 2022] GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:11:16.785260 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-f2434991-5f7b-45fd-b4e6-1da2a2bf4f8f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:11:16.785929 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-f2434991-5f7b-45fd-b4e6-1da2a2bf4f8f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:11:16.792716 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f2434991-5f7b-45fd-b4e6-1da2a2bf4f8f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:16.793197 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f2434991-5f7b-45fd-b4e6-1da2a2bf4f8f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:16.793628 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f2434991-5f7b-45fd-b4e6-1da2a2bf4f8f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:16.794329 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f2434991-5f7b-45fd-b4e6-1da2a2bf4f8f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:16.794777 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f2434991-5f7b-45fd-b4e6-1da2a2bf4f8f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:16.795192 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-f2434991-5f7b-45fd-b4e6-1da2a2bf4f8f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:16.936148 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-f2434991-5f7b-45fd-b4e6-1da2a2bf4f8f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:11:16.945412 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-f2434991-5f7b-45fd-b4e6-1da2a2bf4f8f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb" status: 200 len: 1454 microversion: 2.1 time: 0.163999 Oct 30 01:11:16.945999 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 611/1241] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:11:16 2022] GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:11:19.057587 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-40868fb0-2e99-460b-bcee-712d34e09075 req-9001eaab-63ca-4dac-bc0e-a38440ab0b10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eff06cea-0743-4940-be64-49f2fe7690bb", "tag": "bed349be-cd91-4758-afdf-c74830850515"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:11:19.073660 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-40868fb0-2e99-460b-bcee-712d34e09075 req-9001eaab-63ca-4dac-bc0e-a38440ab0b10 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:11:19.074165 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-40868fb0-2e99-460b-bcee-712d34e09075 req-9001eaab-63ca-4dac-bc0e-a38440ab0b10 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:11:19.074594 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-40868fb0-2e99-460b-bcee-712d34e09075 req-9001eaab-63ca-4dac-bc0e-a38440ab0b10 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:11:19.088005 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-40868fb0-2e99-460b-bcee-712d34e09075 req-9001eaab-63ca-4dac-bc0e-a38440ab0b10 service nova] Creating event network-changed:bed349be-cd91-4758-afdf-c74830850515 for instance eff06cea-0743-4940-be64-49f2fe7690bb on hv-cinder-86149 Oct 30 01:11:19.095138 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-40868fb0-2e99-460b-bcee-712d34e09075 req-9001eaab-63ca-4dac-bc0e-a38440ab0b10 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039943 Oct 30 01:11:19.096010 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 631/1242] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 30 01:13:22.644437 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:22.649992 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_api:SELECT=22 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:22.649992 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG dbcounter [-] [125554] Writing DB stats nova_cell1:SELECT=50 {{(pid=125554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:22.649992 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 30 01:13:22.649992 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Sun Oct 30 01:13:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 30 01:13:22.651982 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG dbcounter [-] [125553] Writing DB stats nova_cell1:SELECT=54 {{(pid=125553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 30 01:13:22.652168 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 30 01:13:22.652168 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Sun Oct 30 01:13:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.36) !!! Oct 30 01:13:22.653793 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 30 01:13:22.654055 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Sun Oct 30 01:13:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb (ip 10.222.0.36) !!! Oct 30 01:13:22.655943 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 30 01:13:22.656247 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Sun Oct 30 01:13:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb (ip 10.222.0.36) !!! Oct 30 01:13:22.662401 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-08845894-5668-4ba0-b688-2248576017b4 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:22.662971 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-08845894-5668-4ba0-b688-2248576017b4 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:22.673035 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-08845894-5668-4ba0-b688-2248576017b4 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:22.673821 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-08845894-5668-4ba0-b688-2248576017b4 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:22.674261 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-08845894-5668-4ba0-b688-2248576017b4 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:22.674968 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-08845894-5668-4ba0-b688-2248576017b4 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:22.675417 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-08845894-5668-4ba0-b688-2248576017b4 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:22.676073 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-08845894-5668-4ba0-b688-2248576017b4 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:22.704390 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-08845894-5668-4ba0-b688-2248576017b4 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Going to try to terminate instance {{(pid=125553) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:13:22.747520 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [req-1890ddaa-068c-4531-b56f-1bdd0d034713 req-203f1d35-c1a7-4973-b87b-8a1fd96c1169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eff06cea-0743-4940-be64-49f2fe7690bb", "tag": "bed349be-cd91-4758-afdf-c74830850515"}]} {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:22.759064 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-1890ddaa-068c-4531-b56f-1bdd0d034713 req-203f1d35-c1a7-4973-b87b-8a1fd96c1169 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:22.759693 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-1890ddaa-068c-4531-b56f-1bdd0d034713 req-203f1d35-c1a7-4973-b87b-8a1fd96c1169 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:22.760216 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [req-1890ddaa-068c-4531-b56f-1bdd0d034713 req-203f1d35-c1a7-4973-b87b-8a1fd96c1169 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:22.772692 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.compute.server_external_events [req-1890ddaa-068c-4531-b56f-1bdd0d034713 req-203f1d35-c1a7-4973-b87b-8a1fd96c1169 service nova] Creating event network-changed:bed349be-cd91-4758-afdf-c74830850515 for instance eff06cea-0743-4940-be64-49f2fe7690bb on hv-cinder-86149 Oct 30 01:13:22.779295 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [req-1890ddaa-068c-4531-b56f-1bdd0d034713 req-203f1d35-c1a7-4973-b87b-8a1fd96c1169 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134516 Oct 30 01:13:22.780469 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 632/1243] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:13:22.789806 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-08845894-5668-4ba0-b688-2248576017b4 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "DELETE /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb" status: 204 len: 0 microversion: 2.1 time: 0.147364 Oct 30 01:13:22.790430 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 612/1244] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 01:13:22 2022] DELETE /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:13:22.800293 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-6a53bd4c-a24d-4a2b-9d6e-fcc21da0ade4 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:22.801020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-6a53bd4c-a24d-4a2b-9d6e-fcc21da0ade4 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:22.807302 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6a53bd4c-a24d-4a2b-9d6e-fcc21da0ade4 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:22.807821 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6a53bd4c-a24d-4a2b-9d6e-fcc21da0ade4 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:22.808290 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6a53bd4c-a24d-4a2b-9d6e-fcc21da0ade4 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:22.808986 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6a53bd4c-a24d-4a2b-9d6e-fcc21da0ade4 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:22.809433 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6a53bd4c-a24d-4a2b-9d6e-fcc21da0ade4 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:22.809855 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-6a53bd4c-a24d-4a2b-9d6e-fcc21da0ade4 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:22.951060 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-6a53bd4c-a24d-4a2b-9d6e-fcc21da0ade4 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:22.960258 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-6a53bd4c-a24d-4a2b-9d6e-fcc21da0ade4 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb" status: 200 len: 1578 microversion: 2.1 time: 0.165121 Oct 30 01:13:22.961194 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 633/1245] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:22 2022] GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:23.988586 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-84041d4f-3aa3-466b-ad78-9b55bb2b598b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:23.988586 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-84041d4f-3aa3-466b-ad78-9b55bb2b598b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:23.993182 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-84041d4f-3aa3-466b-ad78-9b55bb2b598b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:23.993670 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-84041d4f-3aa3-466b-ad78-9b55bb2b598b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:23.994196 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-84041d4f-3aa3-466b-ad78-9b55bb2b598b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:23.996726 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-84041d4f-3aa3-466b-ad78-9b55bb2b598b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:23.997566 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-84041d4f-3aa3-466b-ad78-9b55bb2b598b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:23.997684 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-84041d4f-3aa3-466b-ad78-9b55bb2b598b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:24.134584 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-84041d4f-3aa3-466b-ad78-9b55bb2b598b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:24.147557 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-84041d4f-3aa3-466b-ad78-9b55bb2b598b tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb" status: 200 len: 1578 microversion: 2.1 time: 0.164048 Oct 30 01:13:24.148471 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 613/1246] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:23 2022] GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:25.171355 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-98d5ee4a-3076-44c5-9abb-9cae4ff6adfe tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:25.172202 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-98d5ee4a-3076-44c5-9abb-9cae4ff6adfe tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:25.180433 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-98d5ee4a-3076-44c5-9abb-9cae4ff6adfe tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:25.181868 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-98d5ee4a-3076-44c5-9abb-9cae4ff6adfe tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:25.182047 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-98d5ee4a-3076-44c5-9abb-9cae4ff6adfe tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:25.183633 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-98d5ee4a-3076-44c5-9abb-9cae4ff6adfe tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:25.183633 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-98d5ee4a-3076-44c5-9abb-9cae4ff6adfe tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:25.184020 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-98d5ee4a-3076-44c5-9abb-9cae4ff6adfe tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:25.189726 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-27fc4903-f3e1-48cd-becc-dec98e21b347 req-03e40f18-2125-4206-8190-e8e943fdcb04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eff06cea-0743-4940-be64-49f2fe7690bb", "name": "network-vif-deleted", "tag": "bed349be-cd91-4758-afdf-c74830850515"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:25.201061 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-27fc4903-f3e1-48cd-becc-dec98e21b347 req-03e40f18-2125-4206-8190-e8e943fdcb04 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:25.202022 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-27fc4903-f3e1-48cd-becc-dec98e21b347 req-03e40f18-2125-4206-8190-e8e943fdcb04 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:25.202453 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-27fc4903-f3e1-48cd-becc-dec98e21b347 req-03e40f18-2125-4206-8190-e8e943fdcb04 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:25.214408 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-27fc4903-f3e1-48cd-becc-dec98e21b347 req-03e40f18-2125-4206-8190-e8e943fdcb04 service nova] Creating event network-vif-deleted:bed349be-cd91-4758-afdf-c74830850515 for instance eff06cea-0743-4940-be64-49f2fe7690bb on hv-cinder-86149 Oct 30 01:13:25.223189 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-27fc4903-f3e1-48cd-becc-dec98e21b347 req-03e40f18-2125-4206-8190-e8e943fdcb04 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037072 Oct 30 01:13:25.231538 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 614/1247] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:13:25.262819 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-98d5ee4a-3076-44c5-9abb-9cae4ff6adfe tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:25.271383 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-98d5ee4a-3076-44c5-9abb-9cae4ff6adfe tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb" status: 200 len: 1392 microversion: 2.1 time: 0.104297 Oct 30 01:13:25.271955 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 634/1248] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:25 2022] GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb => generated 1392 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:26.296709 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-2a160aab-198d-4e79-b84c-0a7aaf3f0615 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:26.297311 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-2a160aab-198d-4e79-b84c-0a7aaf3f0615 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eff06cea-0743-4940-be64-49f2fe7690bb] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:26.303396 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2a160aab-198d-4e79-b84c-0a7aaf3f0615 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:26.303874 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2a160aab-198d-4e79-b84c-0a7aaf3f0615 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:26.304347 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2a160aab-198d-4e79-b84c-0a7aaf3f0615 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:26.305040 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2a160aab-198d-4e79-b84c-0a7aaf3f0615 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:26.305523 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2a160aab-198d-4e79-b84c-0a7aaf3f0615 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:26.305942 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-2a160aab-198d-4e79-b84c-0a7aaf3f0615 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:26.321403 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-2a160aab-198d-4e79-b84c-0a7aaf3f0615 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] HTTP exception thrown: Instance eff06cea-0743-4940-be64-49f2fe7690bb could not be found. Oct 30 01:13:26.322987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-2a160aab-198d-4e79-b84c-0a7aaf3f0615 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Request method failure captured: Oct 30 01:13:26.322987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb HTTP/1.1 Oct 30 01:13:26.322987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 01:13:26.322987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 01:13:26.322987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 01:13:26.322987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 01:13:26.322987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 01:13:26.322987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 01:13:26.322987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 01:13:26.322987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 01:13:26.322987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXc3U7zEArvqu2QGSA-clD8ha0CewgqJFH1q4iJxZVv7K0xIiIecT4jsir217BP3qBgrKVdHygaUsKTS2mC8JxKRvp19cjhydcjuAq8s23ZYKz9z1WMgOFIeD2dofXB0mBImFj0zEPzSwdDHUv8rAXkyfybgvaf8Pnk5g2iGR6ncL6SY Oct 30 01:13:26.322987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 01:13:26.322987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 01:13:26.322987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 01:13:26.322987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 01:13:26.322987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 01:13:26.322987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 01:13:26.322987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: a8a24adf04bb4adfbc7347a5e4ec6b52 Oct 30 01:13:26.322987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-TestVolumeBootPattern-243364429 Oct 30 01:13:26.322987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 01:13:26.322987 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 01:13:26.324932 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a8a24adf04bb4adfbc7347a5e4ec6b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8a24adf04bb4adfbc7347a5e4ec6b52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a8a24adf04bb4adfbc7347a5e4ec6b52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8a24adf04bb4adfbc7347a5e4ec6b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:13:26.324932 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-TestVolumeBootPattern-243364429 Oct 30 01:13:26.324932 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: a8a24adf04bb4adfbc7347a5e4ec6b52 Oct 30 01:13:26.324932 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-TestVolumeBootPattern-243364429 Oct 30 01:13:26.324932 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-TestVolumeBootPattern-243364429-project Oct 30 01:13:26.324932 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 01:13:26.324932 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 01:13:26.324932 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: d6d3fe4f3fbb4dedb7a0703a2bb6884d Oct 30 01:13:26.324932 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-TestVolumeBootPattern-243364429-project Oct 30 01:13:26.324932 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: > Oct 30 01:13:26.324932 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Instance eff06cea-0743-4940-be64-49f2fe7690bb could not be found. Oct 30 01:13:26.324932 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': 'eff06cea-0743-4940-be64-49f2fe7690bb'} Oct 30 01:13:26.326051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:13:26.326051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:26.326051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:13:26.326051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:13:26.326051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:13:26.326051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:13:26.326051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:13:26.326051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:13:26.326051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:13:26.326051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:13:26.326051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eff06cea-0743-4940-be64-49f2fe7690bb could not be found. Oct 30 01:13:26.326051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:13:26.326051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:26.326051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:13:26.326051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:26.326051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:26.326051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:26.326051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:13:26.326051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:13:26.326051 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:13:26.327904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:13:26.327904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:13:26.327904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:13:26.327904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:13:26.327904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:13:26.327904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:13:26.327904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:13:26.327904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eff06cea-0743-4940-be64-49f2fe7690bb could not be found. Oct 30 01:13:26.327904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:13:26.327904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:26.327904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:13:26.327904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:26.327904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:26.327904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:26.327904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:13:26.327904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:13:26.327904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eff06cea-0743-4940-be64-49f2fe7690bb could not be found. Oct 30 01:13:26.327904 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:13:26.329525 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-2a160aab-198d-4e79-b84c-0a7aaf3f0615 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Returning 404 to user: Instance eff06cea-0743-4940-be64-49f2fe7690bb could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:13:26.329525 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-2a160aab-198d-4e79-b84c-0a7aaf3f0615 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb" status: 404 len: 111 microversion: 2.1 time: 0.033221 Oct 30 01:13:26.329525 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 615/1249] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:26 2022] GET /compute/v2.1/servers/eff06cea-0743-4940-be64-49f2fe7690bb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:13:29.386473 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-9187504f-4684-480e-86ca-a0278751133f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:29.387087 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-9187504f-4684-480e-86ca-a0278751133f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:29.389555 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-1edd1c01-c8fc-4bb0-a3b7-db4cdb5a5384 req-eebb817d-017a-42a0-ae59-e44804545625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a96b858-272d-4c54-a3f4-e2d20a8ec7f5", "tag": "5baac346-1954-45fd-802a-77c919eb50ce"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:29.393793 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9187504f-4684-480e-86ca-a0278751133f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:29.394272 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9187504f-4684-480e-86ca-a0278751133f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:29.394704 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9187504f-4684-480e-86ca-a0278751133f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:29.395598 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9187504f-4684-480e-86ca-a0278751133f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:29.396042 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9187504f-4684-480e-86ca-a0278751133f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:29.396492 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-9187504f-4684-480e-86ca-a0278751133f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:29.400588 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-1edd1c01-c8fc-4bb0-a3b7-db4cdb5a5384 req-eebb817d-017a-42a0-ae59-e44804545625 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:29.401350 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-1edd1c01-c8fc-4bb0-a3b7-db4cdb5a5384 req-eebb817d-017a-42a0-ae59-e44804545625 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:29.401992 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-1edd1c01-c8fc-4bb0-a3b7-db4cdb5a5384 req-eebb817d-017a-42a0-ae59-e44804545625 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:29.414452 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-1edd1c01-c8fc-4bb0-a3b7-db4cdb5a5384 req-eebb817d-017a-42a0-ae59-e44804545625 service nova] Creating event network-changed:5baac346-1954-45fd-802a-77c919eb50ce for instance 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 on hv-cinder-86149 Oct 30 01:13:29.420618 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-1edd1c01-c8fc-4bb0-a3b7-db4cdb5a5384 req-eebb817d-017a-42a0-ae59-e44804545625 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034759 Oct 30 01:13:29.421296 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 616/1250] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:13:29.422646 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-9187504f-4684-480e-86ca-a0278751133f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] Going to try to terminate instance {{(pid=125554) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 30 01:13:29.512399 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-9187504f-4684-480e-86ca-a0278751133f tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5" status: 204 len: 0 microversion: 2.1 time: 0.128122 Oct 30 01:13:29.513823 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 635/1251] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 01:13:29 2022] DELETE /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 30 01:13:29.523206 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-4f7a4ab7-fc9b-4e02-b3e4-ca104c106a08 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:29.523916 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-4f7a4ab7-fc9b-4e02-b3e4-ca104c106a08 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:29.530479 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4f7a4ab7-fc9b-4e02-b3e4-ca104c106a08 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:29.531057 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4f7a4ab7-fc9b-4e02-b3e4-ca104c106a08 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:29.531530 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4f7a4ab7-fc9b-4e02-b3e4-ca104c106a08 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:29.532263 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4f7a4ab7-fc9b-4e02-b3e4-ca104c106a08 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:29.532737 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4f7a4ab7-fc9b-4e02-b3e4-ca104c106a08 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:29.533221 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-4f7a4ab7-fc9b-4e02-b3e4-ca104c106a08 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:29.676366 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.policy [None req-4f7a4ab7-fc9b-4e02-b3e4-ca104c106a08 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125553) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:29.684869 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-4f7a4ab7-fc9b-4e02-b3e4-ca104c106a08 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5" status: 200 len: 1580 microversion: 2.1 time: 0.166302 Oct 30 01:13:29.685447 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 617/1252] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:29 2022] GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 => generated 1580 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 30 01:13:30.710022 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-eb1aa330-bccc-4cfd-8448-1844be860fc3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:30.710751 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-eb1aa330-bccc-4cfd-8448-1844be860fc3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:30.717265 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-eb1aa330-bccc-4cfd-8448-1844be860fc3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:30.717748 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-eb1aa330-bccc-4cfd-8448-1844be860fc3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:30.718184 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-eb1aa330-bccc-4cfd-8448-1844be860fc3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:30.718907 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-eb1aa330-bccc-4cfd-8448-1844be860fc3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:30.719353 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-eb1aa330-bccc-4cfd-8448-1844be860fc3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:30.719772 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-eb1aa330-bccc-4cfd-8448-1844be860fc3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:30.865352 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-eb1aa330-bccc-4cfd-8448-1844be860fc3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:30.873676 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-eb1aa330-bccc-4cfd-8448-1844be860fc3 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5" status: 200 len: 1580 microversion: 2.1 time: 0.168267 Oct 30 01:13:30.874261 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 636/1253] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:30 2022] GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 => generated 1580 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:31.893672 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [req-df482546-58f8-40b3-bad2-d169618a7cb5 req-807cbcc9-cbc0-4ac6-87ef-c102b6e08335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a96b858-272d-4c54-a3f4-e2d20a8ec7f5", "name": "network-vif-deleted", "tag": "5baac346-1954-45fd-802a-77c919eb50ce"}]} {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 30 01:13:31.899373 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-be0278d6-cdc3-401a-82a5-2493beb93bd7 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:31.900725 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-be0278d6-cdc3-401a-82a5-2493beb93bd7 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:31.905765 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-df482546-58f8-40b3-bad2-d169618a7cb5 req-807cbcc9-cbc0-4ac6-87ef-c102b6e08335 service nova] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:31.906238 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-df482546-58f8-40b3-bad2-d169618a7cb5 req-807cbcc9-cbc0-4ac6-87ef-c102b6e08335 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:31.906656 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [req-df482546-58f8-40b3-bad2-d169618a7cb5 req-807cbcc9-cbc0-4ac6-87ef-c102b6e08335 service nova] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:31.906812 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-be0278d6-cdc3-401a-82a5-2493beb93bd7 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:31.907246 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-be0278d6-cdc3-401a-82a5-2493beb93bd7 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:31.907683 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-be0278d6-cdc3-401a-82a5-2493beb93bd7 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:31.910199 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-be0278d6-cdc3-401a-82a5-2493beb93bd7 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:31.910663 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-be0278d6-cdc3-401a-82a5-2493beb93bd7 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:31.911093 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-be0278d6-cdc3-401a-82a5-2493beb93bd7 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:31.921945 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.compute.server_external_events [req-df482546-58f8-40b3-bad2-d169618a7cb5 req-807cbcc9-cbc0-4ac6-87ef-c102b6e08335 service nova] Creating event network-vif-deleted:5baac346-1954-45fd-802a-77c919eb50ce for instance 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 on hv-cinder-86149 Oct 30 01:13:31.929496 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [req-df482546-58f8-40b3-bad2-d169618a7cb5 req-807cbcc9-cbc0-4ac6-87ef-c102b6e08335 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040621 Oct 30 01:13:31.930403 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 618/1254] 10.222.0.36 () {64 vars in 1317 bytes} [Sun Oct 30 01:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 30 01:13:31.979093 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.policy [None req-be0278d6-cdc3-401a-82a5-2493beb93bd7 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6d3fe4f3fbb4dedb7a0703a2bb6884d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8a24adf04bb4adfbc7347a5e4ec6b52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125554) authorize /opt/stack/nova/nova/policy.py:199}} Oct 30 01:13:31.987207 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-be0278d6-cdc3-401a-82a5-2493beb93bd7 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5" status: 200 len: 1393 microversion: 2.1 time: 0.091703 Oct 30 01:13:31.987779 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 637/1255] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:31 2022] GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 => generated 1393 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 30 01:13:33.011345 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-235f4a81-50bf-41c6-955e-08f8c7ca7f11 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:33.012037 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-235f4a81-50bf-41c6-955e-08f8c7ca7f11 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:33.019231 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-235f4a81-50bf-41c6-955e-08f8c7ca7f11 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:33.019713 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-235f4a81-50bf-41c6-955e-08f8c7ca7f11 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:33.020273 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-235f4a81-50bf-41c6-955e-08f8c7ca7f11 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:33.020969 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-235f4a81-50bf-41c6-955e-08f8c7ca7f11 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:33.021422 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-235f4a81-50bf-41c6-955e-08f8c7ca7f11 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:33.021846 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-235f4a81-50bf-41c6-955e-08f8c7ca7f11 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:33.036133 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-235f4a81-50bf-41c6-955e-08f8c7ca7f11 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] HTTP exception thrown: Instance 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 could not be found. Oct 30 01:13:33.037767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-235f4a81-50bf-41c6-955e-08f8c7ca7f11 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Request method failure captured: Oct 30 01:13:33.037767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 HTTP/1.1 Oct 30 01:13:33.037767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 01:13:33.037767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 01:13:33.037767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 01:13:33.037767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 01:13:33.037767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 01:13:33.037767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 01:13:33.037767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 01:13:33.037767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 01:13:33.037767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXc3U7zEArvqu2QGSA-clD8ha0CewgqJFH1q4iJxZVv7K0xIiIecT4jsir217BP3qBgrKVdHygaUsKTS2mC8JxKRvp19cjhydcjuAq8s23ZYKz9z1WMgOFIeD2dofXB0mBImFj0zEPzSwdDHUv8rAXkyfybgvaf8Pnk5g2iGR6ncL6SY Oct 30 01:13:33.037767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 01:13:33.037767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 01:13:33.037767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 01:13:33.037767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 01:13:33.037767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 01:13:33.037767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 01:13:33.037767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: a8a24adf04bb4adfbc7347a5e4ec6b52 Oct 30 01:13:33.037767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-TestVolumeBootPattern-243364429 Oct 30 01:13:33.037767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 01:13:33.037767 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 01:13:33.039527 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a8a24adf04bb4adfbc7347a5e4ec6b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8a24adf04bb4adfbc7347a5e4ec6b52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a8a24adf04bb4adfbc7347a5e4ec6b52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8a24adf04bb4adfbc7347a5e4ec6b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:13:33.039527 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-TestVolumeBootPattern-243364429 Oct 30 01:13:33.039527 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: a8a24adf04bb4adfbc7347a5e4ec6b52 Oct 30 01:13:33.039527 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-TestVolumeBootPattern-243364429 Oct 30 01:13:33.039527 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-TestVolumeBootPattern-243364429-project Oct 30 01:13:33.039527 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 01:13:33.039527 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 01:13:33.039527 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: d6d3fe4f3fbb4dedb7a0703a2bb6884d Oct 30 01:13:33.039527 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-TestVolumeBootPattern-243364429-project Oct 30 01:13:33.039527 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: > Oct 30 01:13:33.039527 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Instance 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 could not be found. Oct 30 01:13:33.039527 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': '5a96b858-272d-4c54-a3f4-e2d20a8ec7f5'} Oct 30 01:13:33.040598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:13:33.040598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:33.040598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:13:33.040598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:13:33.040598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:13:33.040598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:13:33.040598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:13:33.040598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:13:33.040598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:13:33.040598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:13:33.040598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 could not be found. Oct 30 01:13:33.040598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:13:33.040598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:33.040598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:13:33.040598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:33.040598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:33.040598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:33.040598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:13:33.040598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:13:33.040598 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:13:33.042213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:13:33.042213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:13:33.042213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:13:33.042213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:13:33.042213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:13:33.042213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:13:33.042213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:13:33.042213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 could not be found. Oct 30 01:13:33.042213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:13:33.042213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:33.042213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:13:33.042213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:33.042213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:33.042213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:33.042213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:13:33.042213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:13:33.042213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 could not be found. Oct 30 01:13:33.042213 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:13:33.043709 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-235f4a81-50bf-41c6-955e-08f8c7ca7f11 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Returning 404 to user: Instance 5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:13:33.043709 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-235f4a81-50bf-41c6-955e-08f8c7ca7f11 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5" status: 404 len: 111 microversion: 2.1 time: 0.032092 Oct 30 01:13:33.043709 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 619/1256] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:33 2022] GET /compute/v2.1/servers/5a96b858-272d-4c54-a3f4-e2d20a8ec7f5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:13:33.496090 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2a46d47b-5f6f-4179-b14e-d9dc2e764960 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:33.496623 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.compute.api [None req-2a46d47b-5f6f-4179-b14e-d9dc2e764960 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125554) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:33.503764 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2a46d47b-5f6f-4179-b14e-d9dc2e764960 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:33.504270 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2a46d47b-5f6f-4179-b14e-d9dc2e764960 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:33.504702 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2a46d47b-5f6f-4179-b14e-d9dc2e764960 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:33.505408 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2a46d47b-5f6f-4179-b14e-d9dc2e764960 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:33.505855 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2a46d47b-5f6f-4179-b14e-d9dc2e764960 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:33.506275 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG oslo_concurrency.lockutils [None req-2a46d47b-5f6f-4179-b14e-d9dc2e764960 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125554) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:33.520919 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.wsgi [None req-2a46d47b-5f6f-4179-b14e-d9dc2e764960 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] HTTP exception thrown: Instance eb312adb-3d03-43c7-aadf-adc7cc771e65 could not be found. Oct 30 01:13:33.522559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2a46d47b-5f6f-4179-b14e-d9dc2e764960 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Request method failure captured: Oct 30 01:13:33.522559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: request: DELETE /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 HTTP/1.1 Oct 30 01:13:33.522559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept: application/json Oct 30 01:13:33.522559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Accept-Encoding: identity Oct 30 01:13:33.522559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Connection: close Oct 30 01:13:33.522559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Length: 0 Oct 30 01:13:33.522559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Content-Type: application/json Oct 30 01:13:33.522559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Host: 10.222.0.36 Oct 30 01:13:33.522559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: Openstack-System-Scope: None Oct 30 01:13:33.522559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: User-Agent: python-urllib3/1.26.12 Oct 30 01:13:33.522559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Auth-Token: gAAAAABjXc3U7zEArvqu2QGSA-clD8ha0CewgqJFH1q4iJxZVv7K0xIiIecT4jsir217BP3qBgrKVdHygaUsKTS2mC8JxKRvp19cjhydcjuAq8s23ZYKz9z1WMgOFIeD2dofXB0mBImFj0zEPzSwdDHUv8rAXkyfybgvaf8Pnk5g2iGR6ncL6SY Oct 30 01:13:33.522559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Id: None Oct 30 01:13:33.522559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Domain-Name: None Oct 30 01:13:33.522559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Identity-Status: Confirmed Oct 30 01:13:33.522559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Is-Admin-Project: True Oct 30 01:13:33.522559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Id: default Oct 30 01:13:33.522559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Domain-Name: Default Oct 30 01:13:33.522559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Id: a8a24adf04bb4adfbc7347a5e4ec6b52 Oct 30 01:13:33.522559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Project-Name: tempest-TestVolumeBootPattern-243364429 Oct 30 01:13:33.522559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Role: member,reader Oct 30 01:13:33.522559 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Roles: member,reader Oct 30 01:13:33.524386 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a8a24adf04bb4adfbc7347a5e4ec6b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8a24adf04bb4adfbc7347a5e4ec6b52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a8a24adf04bb4adfbc7347a5e4ec6b52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8a24adf04bb4adfbc7347a5e4ec6b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:13:33.524386 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant: tempest-TestVolumeBootPattern-243364429 Oct 30 01:13:33.524386 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Id: a8a24adf04bb4adfbc7347a5e4ec6b52 Oct 30 01:13:33.524386 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-Tenant-Name: tempest-TestVolumeBootPattern-243364429 Oct 30 01:13:33.524386 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User: tempest-TestVolumeBootPattern-243364429-project Oct 30 01:13:33.524386 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Id: default Oct 30 01:13:33.524386 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Domain-Name: Default Oct 30 01:13:33.524386 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Id: d6d3fe4f3fbb4dedb7a0703a2bb6884d Oct 30 01:13:33.524386 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: X-User-Name: tempest-TestVolumeBootPattern-243364429-project Oct 30 01:13:33.524386 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: method: > Oct 30 01:13:33.524386 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: exception: Instance eb312adb-3d03-43c7-aadf-adc7cc771e65 could not be found. Oct 30 01:13:33.524386 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: action_args: {'id': 'eb312adb-3d03-43c7-aadf-adc7cc771e65'} Oct 30 01:13:33.525390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:13:33.525390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:33.525390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:13:33.525390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:13:33.525390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:13:33.525390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:13:33.525390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:13:33.525390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:13:33.525390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:13:33.525390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:13:33.525390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb312adb-3d03-43c7-aadf-adc7cc771e65 could not be found. Oct 30 01:13:33.525390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:13:33.525390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:33.525390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:13:33.525390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:33.525390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:33.525390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:33.525390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:13:33.525390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:13:33.525390 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:13:33.527065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:13:33.527065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 30 01:13:33.527065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 30 01:13:33.527065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 30 01:13:33.527065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 30 01:13:33.527065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:13:33.527065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:13:33.527065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:13:33.527065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:13:33.527065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb312adb-3d03-43c7-aadf-adc7cc771e65 could not be found. Oct 30 01:13:33.527065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:13:33.527065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:33.527065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:13:33.527065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:33.527065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:33.527065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:33.527065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:13:33.527065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:13:33.527065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb312adb-3d03-43c7-aadf-adc7cc771e65 could not be found. Oct 30 01:13:33.527065 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: ERROR nova.api.openstack.wsgi Oct 30 01:13:33.528755 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-2a46d47b-5f6f-4179-b14e-d9dc2e764960 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Returning 404 to user: Instance eb312adb-3d03-43c7-aadf-adc7cc771e65 could not be found. {{(pid=125554) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:13:33.528755 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-2a46d47b-5f6f-4179-b14e-d9dc2e764960 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "DELETE /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 404 len: 111 microversion: 2.1 time: 0.031780 Oct 30 01:13:33.528755 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 638/1257] 10.222.0.36 () {58 vars in 1239 bytes} [Sun Oct 30 01:13:33 2022] DELETE /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:13:33.534096 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1a172022-439f-43b1-8ae9-caa8f760c31a tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '>' {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:33.534706 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.compute.api [None req-1a172022-439f-43b1-8ae9-caa8f760c31a tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] [instance: eb312adb-3d03-43c7-aadf-adc7cc771e65] Fetching instance by UUID {{(pid=125553) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 30 01:13:33.540581 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a172022-439f-43b1-8ae9-caa8f760c31a tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:33.541061 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a172022-439f-43b1-8ae9-caa8f760c31a tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:33.541491 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a172022-439f-43b1-8ae9-caa8f760c31a tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:33.542177 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a172022-439f-43b1-8ae9-caa8f760c31a tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Acquiring lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 30 01:13:33.542627 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a172022-439f-43b1-8ae9-caa8f760c31a tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 30 01:13:33.543047 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG oslo_concurrency.lockutils [None req-1a172022-439f-43b1-8ae9-caa8f760c31a tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Lock "ea66ce74-ff55-4058-9ca3-10a503c16d39" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 30 01:13:33.556345 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.wsgi [None req-1a172022-439f-43b1-8ae9-caa8f760c31a tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] HTTP exception thrown: Instance eb312adb-3d03-43c7-aadf-adc7cc771e65 could not be found. Oct 30 01:13:33.557847 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1a172022-439f-43b1-8ae9-caa8f760c31a tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Request method failure captured: Oct 30 01:13:33.557847 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: request: GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 HTTP/1.1 Oct 30 01:13:33.557847 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept: application/json Oct 30 01:13:33.557847 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Accept-Encoding: identity Oct 30 01:13:33.557847 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Connection: close Oct 30 01:13:33.557847 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Length: 0 Oct 30 01:13:33.557847 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Content-Type: application/json Oct 30 01:13:33.557847 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Host: 10.222.0.36 Oct 30 01:13:33.557847 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: Openstack-System-Scope: None Oct 30 01:13:33.557847 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: User-Agent: python-urllib3/1.26.12 Oct 30 01:13:33.557847 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Auth-Token: gAAAAABjXc3U7zEArvqu2QGSA-clD8ha0CewgqJFH1q4iJxZVv7K0xIiIecT4jsir217BP3qBgrKVdHygaUsKTS2mC8JxKRvp19cjhydcjuAq8s23ZYKz9z1WMgOFIeD2dofXB0mBImFj0zEPzSwdDHUv8rAXkyfybgvaf8Pnk5g2iGR6ncL6SY Oct 30 01:13:33.557847 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Id: None Oct 30 01:13:33.557847 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Domain-Name: None Oct 30 01:13:33.557847 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Identity-Status: Confirmed Oct 30 01:13:33.557847 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Is-Admin-Project: True Oct 30 01:13:33.557847 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Id: default Oct 30 01:13:33.557847 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Domain-Name: Default Oct 30 01:13:33.557847 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Id: a8a24adf04bb4adfbc7347a5e4ec6b52 Oct 30 01:13:33.557847 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Project-Name: tempest-TestVolumeBootPattern-243364429 Oct 30 01:13:33.557847 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Role: member,reader Oct 30 01:13:33.557847 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Roles: member,reader Oct 30 01:13:33.559647 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a8a24adf04bb4adfbc7347a5e4ec6b52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8a24adf04bb4adfbc7347a5e4ec6b52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a8a24adf04bb4adfbc7347a5e4ec6b52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a8a24adf04bb4adfbc7347a5e4ec6b52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 30 01:13:33.559647 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant: tempest-TestVolumeBootPattern-243364429 Oct 30 01:13:33.559647 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Id: a8a24adf04bb4adfbc7347a5e4ec6b52 Oct 30 01:13:33.559647 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-Tenant-Name: tempest-TestVolumeBootPattern-243364429 Oct 30 01:13:33.559647 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User: tempest-TestVolumeBootPattern-243364429-project Oct 30 01:13:33.559647 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Id: default Oct 30 01:13:33.559647 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Domain-Name: Default Oct 30 01:13:33.559647 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Id: d6d3fe4f3fbb4dedb7a0703a2bb6884d Oct 30 01:13:33.559647 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: X-User-Name: tempest-TestVolumeBootPattern-243364429-project Oct 30 01:13:33.559647 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: method: > Oct 30 01:13:33.559647 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: exception: Instance eb312adb-3d03-43c7-aadf-adc7cc771e65 could not be found. Oct 30 01:13:33.559647 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: action_args: {'id': 'eb312adb-3d03-43c7-aadf-adc7cc771e65'} Oct 30 01:13:33.560649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: {{(pid=125553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 30 01:13:33.560649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:33.560649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 30 01:13:33.560649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 30 01:13:33.560649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 30 01:13:33.560649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 30 01:13:33.560649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 30 01:13:33.560649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 30 01:13:33.560649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 30 01:13:33.560649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 30 01:13:33.560649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb312adb-3d03-43c7-aadf-adc7cc771e65 could not be found. Oct 30 01:13:33.560649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:13:33.560649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:33.560649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:13:33.560649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:33.560649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:33.560649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:33.560649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 30 01:13:33.560649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 30 01:13:33.560649 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 30 01:13:33.562283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 30 01:13:33.562283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 30 01:13:33.562283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 30 01:13:33.562283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 30 01:13:33.562283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 30 01:13:33.562283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 30 01:13:33.562283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 30 01:13:33.562283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb312adb-3d03-43c7-aadf-adc7cc771e65 could not be found. Oct 30 01:13:33.562283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:13:33.562283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 30 01:13:33.562283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:13:33.562283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 30 01:13:33.562283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 30 01:13:33.562283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 30 01:13:33.562283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 30 01:13:33.562283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 30 01:13:33.562283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb312adb-3d03-43c7-aadf-adc7cc771e65 could not be found. Oct 30 01:13:33.562283 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: ERROR nova.api.openstack.wsgi Oct 30 01:13:33.563777 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: DEBUG nova.api.openstack.wsgi [None req-1a172022-439f-43b1-8ae9-caa8f760c31a tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Returning 404 to user: Instance eb312adb-3d03-43c7-aadf-adc7cc771e65 could not be found. {{(pid=125553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 30 01:13:33.563777 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: INFO nova.api.openstack.requestlog [None req-1a172022-439f-43b1-8ae9-caa8f760c31a tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65" status: 404 len: 111 microversion: 2.1 time: 0.029068 Oct 30 01:13:33.563777 dv-cinder-861491-6-iscsi devstack@n-api.service[125553]: [pid: 125553|app: 0|req: 620/1258] 10.222.0.36 () {58 vars in 1236 bytes} [Sun Oct 30 01:13:33 2022] GET /compute/v2.1/servers/eb312adb-3d03-43c7-aadf-adc7cc771e65 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 30 01:13:34.858517 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: DEBUG nova.api.openstack.wsgi [None req-5d47ddf5-1042-4844-9664-7aabeeb2a688 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] Calling method '.version_select at 0x7faf75d5d5e0>' {{(pid=125554) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 30 01:13:34.884570 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: INFO nova.api.openstack.requestlog [None req-5d47ddf5-1042-4844-9664-7aabeeb2a688 tempest-TestVolumeBootPattern-243364429 tempest-TestVolumeBootPattern-243364429-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1905451183" status: 202 len: 0 microversion: 2.1 time: 0.029829 Oct 30 01:13:34.885337 dv-cinder-861491-6-iscsi devstack@n-api.service[125554]: [pid: 125554|app: 0|req: 639/1259] 10.222.0.36 () {58 vars in 1263 bytes} [Sun Oct 30 01:13:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1905451183 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)